2024-09-13T10:57:15.561 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T10:57:15.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T10:57:15.671 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394 branch: wip-aclamk-cbt-combined description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} email: akupczyk@redhat.com first_in_suite: false job_id: '7903394' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-aclamk-cbt-combined ceph: conf: client: debug cephsqlite: 20 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore write v2: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - POOL_APP_NOT_ENABLED - do not have an application enabled sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-aclamk-cbt-combined sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 owner: scheduled_akupczyk@teuthology priority: 160 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5394 sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 sleep_before_teardown: 0 subset: 582/12160 suite: rados suite_branch: wip-aclamk-cbt-combined suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBLsyjux9vrNGw/ofXKdk46PNwaIii1KAfpLvnWKzcNtyxEHZeAsHkX1xresYCTAy/nP673geRxPlsE9smVGEY= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQsvYUdH4i1+Bn3HS7ZcEGmFYCEzmuIvx6yFLvFQ4AaJ4gBS8xwI1vlLhJKz86iRqn4WRscwVfsBF6rvo6I/Ts= tasks: - install: extra_system_packages: deb: - sqlite3 rpm: - sqlite-devel - ceph: null - exec: client.0: - ceph osd pool create cephsqlite - ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring - exec: client.0: - ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr - workunit: clients: client.0: - rados/test_libcephsqlite.sh cephsqlite env: CEPH_ARGS: --id libcephsqlite --no-log-to-stderr teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_09:37:56 tube: smithi user: akupczyk verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T10:57:15.671 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa; will attempt to use it 2024-09-13T10:57:15.672 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa/tasks 2024-09-13T10:57:15.672 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T10:57:15.673 INFO:teuthology.task.internal:Checking packages... 2024-09-13T10:57:15.696 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd58f73069a8157a9ace12a0247ee3e8497707ea9' 2024-09-13T10:57:15.696 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T10:57:15.696 INFO:teuthology.packaging:ref: None 2024-09-13T10:57:15.696 INFO:teuthology.packaging:tag: None 2024-09-13T10:57:15.697 INFO:teuthology.packaging:branch: wip-aclamk-cbt-combined 2024-09-13T10:57:15.697 INFO:teuthology.packaging:sha1: d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T10:57:15.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-aclamk-cbt-combined 2024-09-13T10:57:15.841 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4697-gd58f7306-1jammy 2024-09-13T10:57:15.842 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T10:57:15.848 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T10:57:15.849 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T10:57:15.882 INFO:teuthology.task.internal:Saving configuration 2024-09-13T10:57:15.896 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T10:57:15.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T10:57:15.931 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 10:50:42.098699', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJvSozfT4BdVX5VClAyXtn8WienXlNvyCxXulH9cEu3w'} 2024-09-13T10:57:15.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 10:50:42.096839', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFc6HcfaFIyjJca+PSmR4/tLjSUd4t8hyYhNSicvwxCf'} 2024-09-13T10:57:15.951 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T10:57:15.957 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-13T10:57:15.958 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-13T10:57:15.958 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T10:57:16.037 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcae2827be0>, signals=[15]) 2024-09-13T10:57:16.037 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T10:57:16.043 INFO:teuthology.task.internal:Opening connections... 2024-09-13T10:57:16.043 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T10:57:16.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:57:16.126 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T10:57:16.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:57:16.203 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T10:57:16.209 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-09-13T10:57:16.214 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-09-13T10:57:16.215 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T10:57:16.264 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T10:57:16.265 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T10:57:16.265 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T10:57:16.265 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2024-09-13T10:57:16.265 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-09-13T10:57:16.285 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-13T10:57:16.290 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-13T10:57:16.290 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2024-09-13T10:57:16.337 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T10:57:16.338 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T10:57:16.338 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T10:57:16.338 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T10:57:16.338 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2024-09-13T10:57:16.338 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-13T10:57:16.359 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T10:57:16.366 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T10:57:16.432 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T10:57:16.432 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-09-13T10:57:16.435 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-13T10:57:16.440 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T10:57:16.457 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T10:57:16.458 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-09-13T10:57:16.484 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-13T10:57:16.634 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T10:57:16.688 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T10:57:16.702 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T10:57:16.702 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T10:57:16.703 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T10:57:16.703 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T10:57:16.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:57:16.708 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-13T10:57:16.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T10:57:16.709 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-13T10:57:16.755 INFO:teuthology.orchestra.run.smithi039.stdout:5.15.0-56-generic 2024-09-13T10:57:16.755 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.15.0-56-generic 2024-09-13T10:57:16.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get clean 2024-09-13T10:57:16.757 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-56-generic 2024-09-13T10:57:16.757 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.15.0-56-generic 2024-09-13T10:57:16.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-09-13T10:57:16.881 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get update 2024-09-13T10:57:16.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-13T10:57:17.035 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T10:57:17.035 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T10:57:17.035 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T10:57:17.109 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T10:57:17.186 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T10:57:17.186 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T10:57:17.238 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T10:57:17.261 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T10:57:17.344 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T10:57:17.362 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T10:57:17.367 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T10:57:17.369 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T10:57:17.370 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T10:57:17.371 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T10:57:17.397 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T10:57:17.403 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T10:57:17.403 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T10:57:17.409 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T10:57:17.416 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T10:57:17.418 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T10:57:17.423 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T10:57:17.430 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T10:57:17.430 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T10:57:17.459 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T10:57:17.460 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T10:57:17.460 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T10:57:17.460 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T10:57:17.460 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T10:57:17.480 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T10:57:17.481 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T10:57:17.484 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T10:57:17.485 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T10:57:17.494 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T10:57:17.500 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T10:57:17.503 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T10:57:17.503 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T10:57:17.503 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T10:57:17.513 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T10:57:17.514 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T10:57:17.514 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T10:57:17.515 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T10:57:17.521 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T10:57:17.522 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T10:57:17.522 INFO:teuthology.orchestra.run.smithi039.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T10:57:17.522 INFO:teuthology.orchestra.run.smithi039.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T10:57:17.522 INFO:teuthology.orchestra.run.smithi039.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T10:57:17.530 INFO:teuthology.orchestra.run.smithi039.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T10:57:17.594 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T10:57:17.621 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T10:57:17.748 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T10:57:17.973 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T10:57:18.056 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T10:57:18.072 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T10:57:18.081 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T10:57:18.082 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T10:57:18.128 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T10:57:18.141 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T10:57:18.141 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T10:57:18.143 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T10:57:18.178 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T10:57:18.180 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T10:57:18.190 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T10:57:18.243 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T10:57:18.243 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T10:57:18.249 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T10:57:18.249 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T10:57:18.254 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T10:57:18.262 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T10:57:18.264 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T10:57:18.265 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T10:57:18.265 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T10:57:18.266 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T10:57:18.281 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T10:57:18.287 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T10:57:18.293 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T10:57:18.293 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T10:57:18.294 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T10:57:18.323 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T10:57:18.323 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T10:57:18.369 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T10:57:18.370 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T10:57:18.371 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T10:57:18.373 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T10:57:18.373 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T10:57:18.377 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T10:57:18.377 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T10:57:18.457 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T10:57:18.457 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T10:57:23.981 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 16.0 MB in 2s (7,203 kB/s) 2024-09-13T10:57:24.308 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 16.0 MB in 3s (5,678 kB/s) 2024-09-13T10:57:25.369 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T10:57:25.386 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T10:57:25.446 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T10:57:25.636 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2024-09-13T10:57:25.637 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2024-09-13T10:57:25.763 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T10:57:25.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T10:57:25.812 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T10:57:25.812 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T10:57:25.813 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T10:57:25.813 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T10:57:25.813 INFO:teuthology.orchestra.run.smithi039.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T10:57:25.813 INFO:teuthology.orchestra.run.smithi039.stdout: python2.7-minimal 2024-09-13T10:57:25.814 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T10:57:25.814 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2024-09-13T10:57:25.814 INFO:teuthology.orchestra.run.smithi039.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T10:57:25.815 INFO:teuthology.orchestra.run.smithi039.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T10:57:25.815 INFO:teuthology.orchestra.run.smithi039.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T10:57:25.816 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2024-09-13T10:57:25.816 INFO:teuthology.orchestra.run.smithi039.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T10:57:25.816 INFO:teuthology.orchestra.run.smithi039.stdout:Recommended packages: 2024-09-13T10:57:25.816 INFO:teuthology.orchestra.run.smithi039.stdout: thermald 2024-09-13T10:57:25.844 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T10:57:25.856 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2024-09-13T10:57:25.856 INFO:teuthology.orchestra.run.smithi039.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T10:57:25.857 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T10:57:25.857 INFO:teuthology.orchestra.run.smithi039.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T10:57:25.858 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages will be upgraded: 2024-09-13T10:57:25.859 INFO:teuthology.orchestra.run.smithi039.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T10:57:25.911 INFO:teuthology.orchestra.run.smithi039.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T10:57:25.911 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 113 MB of archives. 2024-09-13T10:57:25.911 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T10:57:25.911 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T10:57:26.033 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-13T10:57:26.033 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-13T10:57:26.198 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T10:57:26.198 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T10:57:26.198 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T10:57:26.199 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T10:57:26.199 INFO:teuthology.orchestra.run.smithi102.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T10:57:26.199 INFO:teuthology.orchestra.run.smithi102.stdout: python2.7-minimal 2024-09-13T10:57:26.199 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T10:57:26.200 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-13T10:57:26.200 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T10:57:26.200 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T10:57:26.200 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T10:57:26.202 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-13T10:57:26.202 INFO:teuthology.orchestra.run.smithi102.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T10:57:26.202 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-13T10:57:26.202 INFO:teuthology.orchestra.run.smithi102.stdout: thermald 2024-09-13T10:57:26.247 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-13T10:57:26.247 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T10:57:26.247 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T10:57:26.247 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T10:57:26.249 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-09-13T10:57:26.249 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T10:57:26.299 INFO:teuthology.orchestra.run.smithi102.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T10:57:26.299 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 113 MB of archives. 2024-09-13T10:57:26.300 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T10:57:26.300 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T10:57:26.365 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T10:57:26.544 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T10:57:26.735 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T10:57:26.825 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T10:57:27.354 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T10:57:27.354 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T10:57:27.354 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T10:57:27.484 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T10:57:27.506 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T10:57:27.629 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T10:57:27.629 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T10:57:27.629 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T10:57:27.747 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T10:57:27.767 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T10:57:27.901 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 113 MB in 2s (69.1 MB/s) 2024-09-13T10:57:28.076 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T10:57:28.234 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 113 MB in 2s (71.7 MB/s) 2024-09-13T10:57:28.399 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T10:57:30.025 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T10:57:30.029 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:30.114 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:30.515 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T10:57:30.519 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:30.605 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:32.140 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T10:57:32.161 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:32.249 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:32.668 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T10:57:32.689 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:32.726 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:32.748 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T10:57:32.770 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:32.858 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:33.260 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T10:57:33.281 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:33.310 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:39.432 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T10:57:39.559 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T10:57:39.745 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T10:57:39.872 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T10:57:39.909 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T10:57:40.037 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T10:57:40.205 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T10:57:40.309 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T10:57:40.357 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T10:57:40.372 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T10:57:40.415 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T10:57:40.595 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T10:57:40.618 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T10:57:40.653 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T10:57:46.145 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T10:57:46.182 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:46.203 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T10:57:46.228 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:46.239 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T10:57:46.278 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:48.815 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T10:57:48.916 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T10:57:48.970 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T10:57:49.091 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T10:57:49.267 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T10:57:49.417 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T10:57:49.513 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:49.538 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:49.639 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T10:57:49.639 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T10:57:49.750 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:49.767 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:51.047 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T10:57:51.047 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T10:57:51.047 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T10:57:51.047 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T10:57:51.203 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:51.214 INFO:teuthology.orchestra.run.smithi039.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T10:57:51.214 INFO:teuthology.orchestra.run.smithi039.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T10:57:51.214 INFO:teuthology.orchestra.run.smithi039.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T10:57:51.214 INFO:teuthology.orchestra.run.smithi039.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T10:57:51.379 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:52.811 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:53.256 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:54.682 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T10:57:54.808 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T10:57:54.915 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T10:57:54.934 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:54.996 INFO:teuthology.orchestra.run.smithi039.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T10:57:54.996 INFO:teuthology.orchestra.run.smithi039.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T10:57:55.040 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T10:57:55.167 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T10:57:55.233 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T10:57:55.233 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T10:58:09.450 INFO:teuthology.orchestra.run.smithi039.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T10:58:09.450 INFO:teuthology.orchestra.run.smithi039.stdout:Sourcing file `/etc/default/grub' 2024-09-13T10:58:09.461 INFO:teuthology.orchestra.run.smithi039.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T10:58:09.487 INFO:teuthology.orchestra.run.smithi039.stdout:Generating grub configuration file ... 2024-09-13T10:58:09.713 INFO:teuthology.orchestra.run.smithi039.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T10:58:09.730 INFO:teuthology.orchestra.run.smithi039.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T10:58:10.000 INFO:teuthology.orchestra.run.smithi039.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T10:58:10.005 INFO:teuthology.orchestra.run.smithi039.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T10:58:10.063 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T10:58:10.064 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub' 2024-09-13T10:58:10.072 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T10:58:10.077 INFO:teuthology.orchestra.run.smithi039.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T10:58:10.083 INFO:teuthology.orchestra.run.smithi039.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T10:58:10.092 INFO:teuthology.orchestra.run.smithi102.stdout:Generating grub configuration file ... 2024-09-13T10:58:10.283 INFO:teuthology.orchestra.run.smithi039.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T10:58:10.283 INFO:teuthology.orchestra.run.smithi039.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T10:58:10.283 INFO:teuthology.orchestra.run.smithi039.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T10:58:10.327 INFO:teuthology.orchestra.run.smithi039.stdout:done 2024-09-13T10:58:10.341 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T10:58:10.358 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T10:58:10.625 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T10:58:10.630 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T10:58:10.699 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T10:58:10.705 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T10:58:10.834 DEBUG:teuthology.orchestra.run.smithi039:> dpkg -s linux-image-generic 2024-09-13T10:58:10.855 INFO:teuthology.orchestra.run.smithi039.stdout:Package: linux-image-generic 2024-09-13T10:58:10.855 INFO:teuthology.orchestra.run.smithi039.stdout:Status: install ok installed 2024-09-13T10:58:10.855 INFO:teuthology.orchestra.run.smithi039.stdout:Priority: optional 2024-09-13T10:58:10.855 INFO:teuthology.orchestra.run.smithi039.stdout:Section: kernel 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Installed-Size: 21 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: amd64 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Source: linux-meta 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Version: 5.15.0.121.121 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Recommends: thermald 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout:Description: Generic Linux kernel image 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout: This package will always depend on the latest generic kernel image 2024-09-13T10:58:10.856 INFO:teuthology.orchestra.run.smithi039.stdout: available. 2024-09-13T10:58:10.857 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T10:58:10.857 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T10:58:10.857 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T10:58:10.857 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T10:58:10.857 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T10:58:10.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get clean 2024-09-13T10:58:10.862 INFO:teuthology.orchestra.run.smithi102.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T10:58:10.863 INFO:teuthology.orchestra.run.smithi102.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T10:58:10.863 INFO:teuthology.orchestra.run.smithi102.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T10:58:10.899 INFO:teuthology.orchestra.run.smithi102.stdout:done 2024-09-13T10:58:11.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get update 2024-09-13T10:58:11.303 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T10:58:11.303 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T10:58:11.354 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-09-13T10:58:11.374 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T10:58:11.375 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 21 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.15.0.121.121 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-09-13T10:58:11.376 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-09-13T10:58:11.377 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-09-13T10:58:11.377 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-09-13T10:58:11.378 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T10:58:11.378 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T10:58:11.378 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T10:58:11.378 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T10:58:11.378 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T10:58:11.378 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-09-13T10:58:11.456 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T10:58:11.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-13T10:58:11.653 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T10:58:11.663 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T10:58:11.679 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T10:58:11.774 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T10:58:12.788 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T10:58:12.807 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T10:58:12.873 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T10:58:13.062 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T10:58:13.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T10:58:13.087 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2024-09-13T10:58:13.087 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2024-09-13T10:58:13.142 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T10:58:13.287 INFO:teuthology.orchestra.run.smithi039.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T10:58:13.287 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T10:58:13.287 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T10:58:13.288 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T10:58:13.288 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T10:58:13.288 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T10:58:13.288 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T10:58:13.288 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T10:58:13.333 INFO:teuthology.orchestra.run.smithi039.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T10:58:13.335 DEBUG:teuthology.orchestra.run.smithi039:> dpkg -s linux-image-generic 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Package: linux-image-generic 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Status: install ok installed 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Priority: optional 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Section: kernel 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Installed-Size: 21 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: amd64 2024-09-13T10:58:13.351 INFO:teuthology.orchestra.run.smithi039.stdout:Source: linux-meta 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout:Version: 5.15.0.121.121 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout:Recommends: thermald 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout:Description: Generic Linux kernel image 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout: This package will always depend on the latest generic kernel image 2024-09-13T10:58:13.352 INFO:teuthology.orchestra.run.smithi039.stdout: available. 2024-09-13T10:58:13.353 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-13T10:58:13.353 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-13T10:58:13.353 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-13T10:58:13.399 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.Wql75H0A15 2024-09-13T10:58:13.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Wql75H0A15 2024-09-13T10:58:13.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.Wql75H0A15 2024-09-13T10:58:13.534 INFO:teuthology.orchestra.run.smithi102.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T10:58:13.535 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T10:58:13.568 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.Wql75H0A15 is 10KB 2024-09-13T10:58:13.577 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T10:58:13.579 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-09-13T10:58:13.583 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.Wql75H0A15 2024-09-13T10:58:13.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T10:58:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-09-13T10:58:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-09-13T10:58:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-09-13T10:58:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-09-13T10:58:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 21 2024-09-13T10:58:13.593 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.15.0.121.121 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-09-13T10:58:13.594 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-09-13T10:58:13.594 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-13T10:58:13.639 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.wsqC5hroHW 2024-09-13T10:58:13.639 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wsqC5hroHW 2024-09-13T10:58:13.643 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T10:58:13.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T10:58:13.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T10:58:13.689 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.wsqC5hroHW 2024-09-13T10:58:13.710 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T10:58:13.710 DEBUG:teuthology.orchestra.run.smithi039:> sudo update-grub 2024-09-13T10:58:13.813 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.wsqC5hroHW is 10KB 2024-09-13T10:58:13.824 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.wsqC5hroHW 2024-09-13T10:58:13.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T10:58:13.883 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T10:58:13.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T10:58:13.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T10:58:13.947 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T10:58:13.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-grub 2024-09-13T10:58:14.943 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub' 2024-09-13T10:58:14.944 INFO:teuthology.orchestra.run.smithi039.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T10:58:14.947 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-09-13T10:58:15.149 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T10:58:15.154 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T10:58:15.191 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2024-09-13T10:58:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T10:58:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-13T10:58:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T10:58:15.368 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T10:58:15.390 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T10:58:15.393 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T10:58:15.432 INFO:teuthology.orchestra.run.smithi039.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T10:58:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T10:58:15.545 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T10:58:15.546 INFO:teuthology.orchestra.run.smithi039.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T10:58:15.546 INFO:teuthology.orchestra.run.smithi039.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T10:58:15.556 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-09-13T10:58:15.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-09-13T10:58:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T10:58:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T10:58:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T10:58:15.645 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T10:58:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T10:58:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T10:58:15.761 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T10:58:15.786 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-13T10:58:15.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-13T10:58:45.589 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T10:58:45.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T10:58:45.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:58:45.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T10:58:45.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T10:58:45.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:59:04.125 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-13T10:59:04.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-13T10:59:13.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T10:59:13.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:59:13.137 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T10:59:13.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:59:16.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-13T10:59:16.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-13T10:59:28.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T10:59:28.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:59:28.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T10:59:28.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T10:59:31.261 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-09-13T10:59:46.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T10:59:46.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T11:00:00.192 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-13T11:00:00.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T11:00:00.818 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-13T11:00:00.818 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-13T11:00:00.865 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-121-generic 2024-09-13T11:00:00.866 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T11:00:00.866 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T11:00:00.866 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T11:00:01.867 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T11:00:01.867 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T11:00:01.938 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-13T11:00:01.963 DEBUG:teuthology.parallel:result is None 2024-09-13T11:00:46.277 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T11:01:04.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T11:01:04.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T11:01:04.507 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-13T11:01:05.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T11:01:05.317 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T11:01:05.317 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-09-13T11:01:05.364 INFO:teuthology.orchestra.run.smithi039.stdout:5.15.0-121-generic 2024-09-13T11:01:05.365 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T11:01:05.365 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T11:01:05.365 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T11:01:06.365 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T11:01:06.366 DEBUG:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T11:01:06.435 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2024-09-13T11:01:06.457 DEBUG:teuthology.parallel:result is None 2024-09-13T11:01:06.457 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T11:01:06.466 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T11:01:06.466 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T11:01:06.468 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T11:01:06.474 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T11:01:06.495 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T11:01:06.528 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T11:01:06.529 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T11:01:06.531 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T11:01:06.704 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T11:01:06.711 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T11:01:06.712 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T11:01:06.714 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T11:01:06.732 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T11:01:06.736 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T11:01:06.741 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T11:01:06.744 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T11:01:06.746 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T11:01:06.753 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T11:01:06.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T11:01:06.788 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T11:01:06.815 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T11:01:06.824 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T11:01:06.824 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T11:01:06.845 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T11:01:06.861 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T11:01:06.895 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T11:01:06.945 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:01:06.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T11:01:07.009 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T11:01:07.015 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T11:01:07.062 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:01:07.062 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T11:01:07.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-09-13T11:01:07.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-13T11:01:07.201 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T11:01:07.210 INFO:teuthology.task.internal:Starting timer... 2024-09-13T11:01:07.210 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T11:01:07.249 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T11:01:07.282 DEBUG:teuthology.task.selinux:Excluding smithi039: OS 'ubuntu' does not support SELinux 2024-09-13T11:01:07.282 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2024-09-13T11:01:07.282 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T11:01:07.282 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T11:01:07.282 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T11:01:07.282 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T11:01:07.315 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T11:01:07.326 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T11:01:07.327 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T11:08:45.641 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-13T11:08:45.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T11:08:45.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T11:08:45.729 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-09-13T11:08:45.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-09-13T11:08:45.817 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T11:08:45.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T11:08:45.899 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-13T11:08:45.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-13T11:08:45.978 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T11:08:45.989 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T11:08:45.990 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T11:08:45.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T11:08:45.993 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T11:08:45.993 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T11:08:46.021 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Command line: ntpd -gq 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: ---------------------------------------------------- 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: corporation. Support and training for ntp-4 are 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: available at https://www.nwtime.org/support 2024-09-13T11:08:46.022 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: ---------------------------------------------------- 2024-09-13T11:08:46.023 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: proto: precision = 0.066 usec (-24) 2024-09-13T11:08:46.023 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: basedate set to 2022-02-04 2024-09-13T11:08:46.023 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: gps base set to 2022-02-06 (week 2196) 2024-09-13T11:08:46.023 INFO:teuthology.orchestra.run.smithi039.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T11:08:46.023 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T11:08:46.024 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T11:08:46.024 INFO:teuthology.orchestra.run.smithi039.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listen normally on 3 ens1f0 172.21.15.39:123 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listen normally on 4 lo [::1]:123 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1370%3]:123 2024-09-13T11:08:46.025 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:46 ntpd[18356]: Listening on routing socket on fd #22 for interface updates 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Command line: ntpd -gq 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: ---------------------------------------------------- 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-13T11:08:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-13T11:08:46.045 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: ---------------------------------------------------- 2024-09-13T11:08:46.045 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: proto: precision = 0.046 usec (-24) 2024-09-13T11:08:46.045 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: basedate set to 2022-02-04 2024-09-13T11:08:46.045 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-13T11:08:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T11:08:46.046 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T11:08:46.046 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T11:08:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T11:08:46.047 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T11:08:46.047 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T11:08:46.047 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T11:08:46.048 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2024-09-13T11:08:46.048 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-13T11:08:46.048 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2024-09-13T11:08:46.048 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:46 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:47.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:47.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:47.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:47.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:47 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:47 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:47.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:47 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:47 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:47.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:47 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:48.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:48 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:48.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:48 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:48.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:48 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:48.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:48 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:48.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:48 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:48.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:48 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:49.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:49 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:49.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:49 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:50.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:50 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:50.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:50 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:50.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:50 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:50.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:50 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:50.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:50 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:50.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:50 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:50 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:50 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:50.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:50 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:51.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:51 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:51.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:51.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:51 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:52 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:52 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:52 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:52 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:52 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:52.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:52 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:52 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:52 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:52 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:52 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:53.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.022 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stdout:13 Sep 11:08:53 ntpd[18356]: ntpd: time slew -0.000316 s 2024-09-13T11:08:53.023 INFO:teuthology.orchestra.run.smithi039.stdout:ntpd: time slew -0.000316s 2024-09-13T11:08:53.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T11:08:53.024 INFO:teuthology.orchestra.run.smithi039.stderr:13 Sep 11:08:53 ntpd[18356]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T11:08:53.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.045 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T11:08:53.046 INFO:teuthology.orchestra.run.smithi102.stdout:13 Sep 11:08:53 ntpd[18461]: ntpd: time slew -0.001150 s 2024-09-13T11:08:53.047 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew -0.001150s 2024-09-13T11:08:53.047 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T11:08:53.047 INFO:teuthology.orchestra.run.smithi102.stderr:13 Sep 11:08:53 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T11:08:53.072 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T11:08:53.072 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2024-09-13T11:08:53.072 INFO:teuthology.orchestra.run.smithi039.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.072 INFO:teuthology.orchestra.run.smithi039.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.072 INFO:teuthology.orchestra.run.smithi039.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.073 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.101 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T11:08:53.102 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-13T11:08:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.102 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:08:53.102 INFO:teuthology.run_tasks:Running task install... 2024-09-13T11:08:53.111 DEBUG:teuthology.task.install:project ceph 2024-09-13T11:08:53.111 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}} 2024-09-13T11:08:53.111 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'} 2024-09-13T11:08:53.111 INFO:teuthology.task.install:Using flavor: default 2024-09-13T11:08:53.117 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T11:08:53.118 INFO:teuthology.task.install:extra packages: [] 2024-09-13T11:08:53.118 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-key list | grep Ceph 2024-09-13T11:08:53.118 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2024-09-13T11:08:53.174 INFO:teuthology.orchestra.run.smithi039.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T11:08:53.201 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T11:08:53.202 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T11:08:53.202 INFO:teuthology.orchestra.run.smithi039.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T11:08:53.203 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T11:08:53.203 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-09-13T11:08:53.203 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T11:08:53.242 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T11:08:53.242 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T11:08:53.242 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T11:08:53.242 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-09-13T11:08:53.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T11:08:53.365 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default/ 2024-09-13T11:08:53.365 INFO:teuthology.task.install.deb:Package version is 19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:08:53.380 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default/ 2024-09-13T11:08:53.380 INFO:teuthology.task.install.deb:Package version is 19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:08:53.689 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:08:53.689 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T11:08:53.700 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:08:53.700 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T11:08:53.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo apt-get update 2024-09-13T11:08:53.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-13T11:08:53.882 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T11:08:53.883 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T11:08:53.883 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T11:08:53.895 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T11:08:53.913 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T11:08:54.003 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T11:08:54.075 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T11:08:54.085 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T11:08:54.091 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T11:08:54.152 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-13T11:08:54.166 INFO:teuthology.orchestra.run.smithi039.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T11:08:54.169 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-13T11:08:54.231 INFO:teuthology.orchestra.run.smithi039.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T11:08:54.250 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T11:08:54.309 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,426 B] 2024-09-13T11:08:54.331 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-13T11:08:54.394 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-13T11:08:54.420 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,426 B] 2024-09-13T11:08:54.493 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 29.3 kB in 1s (50.4 kB/s) 2024-09-13T11:08:54.509 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 29.3 kB in 1s (49.0 kB/s) 2024-09-13T11:08:55.529 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T11:08:55.533 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T11:08:55.546 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4697-gd58f7306-1jammy cephadm=19.3.0-4697-gd58f7306-1jammy ceph-mds=19.3.0-4697-gd58f7306-1jammy ceph-mgr=19.3.0-4697-gd58f7306-1jammy ceph-common=19.3.0-4697-gd58f7306-1jammy ceph-fuse=19.3.0-4697-gd58f7306-1jammy ceph-test=19.3.0-4697-gd58f7306-1jammy ceph-volume=19.3.0-4697-gd58f7306-1jammy radosgw=19.3.0-4697-gd58f7306-1jammy python3-rados=19.3.0-4697-gd58f7306-1jammy python3-rgw=19.3.0-4697-gd58f7306-1jammy python3-cephfs=19.3.0-4697-gd58f7306-1jammy python3-rbd=19.3.0-4697-gd58f7306-1jammy libcephfs2=19.3.0-4697-gd58f7306-1jammy libcephfs-dev=19.3.0-4697-gd58f7306-1jammy librados2=19.3.0-4697-gd58f7306-1jammy librbd1=19.3.0-4697-gd58f7306-1jammy rbd-fuse=19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:08:55.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4697-gd58f7306-1jammy cephadm=19.3.0-4697-gd58f7306-1jammy ceph-mds=19.3.0-4697-gd58f7306-1jammy ceph-mgr=19.3.0-4697-gd58f7306-1jammy ceph-common=19.3.0-4697-gd58f7306-1jammy ceph-fuse=19.3.0-4697-gd58f7306-1jammy ceph-test=19.3.0-4697-gd58f7306-1jammy ceph-volume=19.3.0-4697-gd58f7306-1jammy radosgw=19.3.0-4697-gd58f7306-1jammy python3-rados=19.3.0-4697-gd58f7306-1jammy python3-rgw=19.3.0-4697-gd58f7306-1jammy python3-cephfs=19.3.0-4697-gd58f7306-1jammy python3-rbd=19.3.0-4697-gd58f7306-1jammy libcephfs2=19.3.0-4697-gd58f7306-1jammy libcephfs-dev=19.3.0-4697-gd58f7306-1jammy librados2=19.3.0-4697-gd58f7306-1jammy librbd1=19.3.0-4697-gd58f7306-1jammy rbd-fuse=19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:08:55.603 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T11:08:55.612 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T11:08:55.789 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-13T11:08:55.790 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-13T11:08:55.828 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2024-09-13T11:08:55.828 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2024-09-13T11:08:55.972 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T11:08:55.972 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T11:08:55.972 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T11:08:55.972 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T11:08:55.973 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T11:08:55.973 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T11:08:55.973 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T11:08:55.973 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-13T11:08:55.974 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T11:08:55.974 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T11:08:55.974 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T11:08:55.974 INFO:teuthology.orchestra.run.smithi102.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T11:08:55.975 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T11:08:55.976 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet zip 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-13T11:08:55.977 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2024-09-13T11:08:56.043 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T11:08:56.044 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T11:08:56.044 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T11:08:56.044 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T11:08:56.044 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T11:08:56.044 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T11:08:56.044 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T11:08:56.045 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2024-09-13T11:08:56.045 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T11:08:56.045 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T11:08:56.046 INFO:teuthology.orchestra.run.smithi039.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T11:08:56.046 INFO:teuthology.orchestra.run.smithi039.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T11:08:56.046 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T11:08:56.046 INFO:teuthology.orchestra.run.smithi039.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T11:08:56.046 INFO:teuthology.orchestra.run.smithi039.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T11:08:56.047 INFO:teuthology.orchestra.run.smithi039.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet zip 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T11:08:56.048 INFO:teuthology.orchestra.run.smithi039.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T11:08:56.049 INFO:teuthology.orchestra.run.smithi039.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T11:08:56.049 INFO:teuthology.orchestra.run.smithi039.stdout:Recommended packages: 2024-09-13T11:08:56.049 INFO:teuthology.orchestra.run.smithi039.stdout: btrfs-tools 2024-09-13T11:08:56.078 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-13T11:08:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T11:08:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T11:08:56.078 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T11:08:56.080 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T11:08:56.081 INFO:teuthology.orchestra.run.smithi102.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T11:08:56.158 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2024-09-13T11:08:56.158 INFO:teuthology.orchestra.run.smithi039.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T11:08:56.158 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T11:08:56.158 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T11:08:56.158 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T11:08:56.159 INFO:teuthology.orchestra.run.smithi039.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T11:08:56.159 INFO:teuthology.orchestra.run.smithi039.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T11:08:56.160 INFO:teuthology.orchestra.run.smithi039.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T11:08:56.160 INFO:teuthology.orchestra.run.smithi039.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T11:08:56.160 INFO:teuthology.orchestra.run.smithi039.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T11:08:56.161 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T11:08:56.162 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T11:08:56.162 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T11:08:56.162 INFO:teuthology.orchestra.run.smithi039.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T11:08:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T11:08:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 251 MB of archives. 2024-09-13T11:08:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-13T11:08:56.266 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T11:08:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4697-gd58f7306-1jammy [3,631 kB] 2024-09-13T11:08:56.349 INFO:teuthology.orchestra.run.smithi039.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T11:08:56.349 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 251 MB of archives. 2024-09-13T11:08:56.349 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-13T11:08:56.349 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T11:08:56.360 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4697-gd58f7306-1jammy [3,631 kB] 2024-09-13T11:08:56.634 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4697-gd58f7306-1jammy [3,320 kB] 2024-09-13T11:08:56.692 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T11:08:56.704 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T11:08:56.769 INFO:teuthology.orchestra.run.smithi039.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T11:08:56.780 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4697-gd58f7306-1jammy [722 kB] 2024-09-13T11:08:56.781 INFO:teuthology.orchestra.run.smithi039.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T11:08:56.785 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T11:08:56.816 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4697-gd58f7306-1jammy [356 kB] 2024-09-13T11:08:56.824 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4697-gd58f7306-1jammy [32.8 kB] 2024-09-13T11:08:56.825 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4697-gd58f7306-1jammy [180 kB] 2024-09-13T11:08:56.828 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4697-gd58f7306-1jammy [71.2 kB] 2024-09-13T11:08:56.830 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4697-gd58f7306-1jammy [338 kB] 2024-09-13T11:08:56.851 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4697-gd58f7306-1jammy [7,979 kB] 2024-09-13T11:08:56.862 INFO:teuthology.orchestra.run.smithi039.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T11:08:57.016 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T11:08:57.026 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T11:08:57.056 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T11:08:57.065 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T11:08:57.066 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T11:08:57.067 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T11:08:57.085 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T11:08:57.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T11:08:57.091 INFO:teuthology.orchestra.run.smithi039.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T11:08:57.094 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T11:08:57.098 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T11:08:57.102 INFO:teuthology.orchestra.run.smithi039.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T11:08:57.132 INFO:teuthology.orchestra.run.smithi039.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T11:08:57.134 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4697-gd58f7306-1jammy [112 kB] 2024-09-13T11:08:57.137 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4697-gd58f7306-1jammy [473 kB] 2024-09-13T11:08:57.141 INFO:teuthology.orchestra.run.smithi039.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T11:08:57.142 INFO:teuthology.orchestra.run.smithi039.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T11:08:57.143 INFO:teuthology.orchestra.run.smithi039.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T11:08:57.149 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4697-gd58f7306-1jammy [28.2 MB] 2024-09-13T11:08:57.161 INFO:teuthology.orchestra.run.smithi039.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T11:08:57.165 INFO:teuthology.orchestra.run.smithi039.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T11:08:57.170 INFO:teuthology.orchestra.run.smithi039.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T11:08:57.174 INFO:teuthology.orchestra.run.smithi039.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T11:08:57.179 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T11:08:57.183 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T11:08:57.187 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T11:08:57.191 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T11:08:57.192 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T11:08:57.192 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T11:08:57.195 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T11:08:57.195 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T11:08:57.195 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T11:08:57.254 INFO:teuthology.orchestra.run.smithi039.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T11:08:57.258 INFO:teuthology.orchestra.run.smithi039.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T11:08:57.261 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T11:08:57.263 INFO:teuthology.orchestra.run.smithi039.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T11:08:57.266 INFO:teuthology.orchestra.run.smithi039.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T11:08:57.268 INFO:teuthology.orchestra.run.smithi039.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T11:08:57.268 INFO:teuthology.orchestra.run.smithi039.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T11:08:57.271 INFO:teuthology.orchestra.run.smithi039.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T11:08:57.271 INFO:teuthology.orchestra.run.smithi039.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T11:08:57.272 INFO:teuthology.orchestra.run.smithi039.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T11:08:57.278 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T11:08:57.279 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T11:08:57.280 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T11:08:57.285 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T11:08:57.286 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T11:08:57.310 INFO:teuthology.orchestra.run.smithi039.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4697-gd58f7306-1jammy [3,320 kB] 2024-09-13T11:08:57.337 INFO:teuthology.orchestra.run.smithi039.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T11:08:57.343 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T11:08:57.343 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T11:08:57.345 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T11:08:57.346 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T11:08:57.354 INFO:teuthology.orchestra.run.smithi039.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T11:08:57.355 INFO:teuthology.orchestra.run.smithi039.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T11:08:57.355 INFO:teuthology.orchestra.run.smithi039.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T11:08:57.361 INFO:teuthology.orchestra.run.smithi039.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T11:08:57.362 INFO:teuthology.orchestra.run.smithi039.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T11:08:57.419 INFO:teuthology.orchestra.run.smithi039.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T11:08:57.420 INFO:teuthology.orchestra.run.smithi039.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T11:08:57.421 INFO:teuthology.orchestra.run.smithi039.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T11:08:57.422 INFO:teuthology.orchestra.run.smithi039.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T11:08:57.424 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T11:08:57.426 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T11:08:57.428 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T11:08:57.429 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T11:08:57.440 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T11:08:57.500 INFO:teuthology.orchestra.run.smithi039.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T11:08:57.502 INFO:teuthology.orchestra.run.smithi039.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T11:08:57.504 INFO:teuthology.orchestra.run.smithi039.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T11:08:57.505 INFO:teuthology.orchestra.run.smithi039.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T11:08:57.505 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T11:08:57.506 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T11:08:57.508 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T11:08:57.510 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T11:08:57.514 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T11:08:57.515 INFO:teuthology.orchestra.run.smithi039.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T11:08:57.581 INFO:teuthology.orchestra.run.smithi039.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T11:08:57.583 INFO:teuthology.orchestra.run.smithi039.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T11:08:57.584 INFO:teuthology.orchestra.run.smithi039.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T11:08:57.586 INFO:teuthology.orchestra.run.smithi039.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T11:08:57.587 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T11:08:57.590 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T11:08:57.590 INFO:teuthology.orchestra.run.smithi039.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T11:08:57.592 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T11:08:57.597 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T11:08:57.598 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T11:08:57.663 INFO:teuthology.orchestra.run.smithi039.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T11:08:57.665 INFO:teuthology.orchestra.run.smithi039.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T11:08:57.667 INFO:teuthology.orchestra.run.smithi039.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T11:08:57.668 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T11:08:57.672 INFO:teuthology.orchestra.run.smithi039.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T11:08:57.673 INFO:teuthology.orchestra.run.smithi039.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T11:08:57.673 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T11:08:57.744 INFO:teuthology.orchestra.run.smithi039.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T11:08:57.749 INFO:teuthology.orchestra.run.smithi039.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T11:08:57.841 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T11:08:57.842 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T11:08:57.845 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T11:08:57.846 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T11:08:57.848 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T11:08:57.869 INFO:teuthology.orchestra.run.smithi039.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4697-gd58f7306-1jammy [722 kB] 2024-09-13T11:08:57.883 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T11:08:57.911 INFO:teuthology.orchestra.run.smithi039.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T11:08:57.913 INFO:teuthology.orchestra.run.smithi039.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T11:08:57.915 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T11:08:57.915 INFO:teuthology.orchestra.run.smithi039.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T11:08:57.916 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T11:08:57.917 INFO:teuthology.orchestra.run.smithi039.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T11:08:57.918 INFO:teuthology.orchestra.run.smithi039.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T11:08:57.944 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T11:08:57.944 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T11:08:57.952 INFO:teuthology.orchestra.run.smithi039.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T11:08:57.955 INFO:teuthology.orchestra.run.smithi039.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T11:08:57.956 INFO:teuthology.orchestra.run.smithi039.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T11:08:57.983 INFO:teuthology.orchestra.run.smithi039.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4697-gd58f7306-1jammy [356 kB] 2024-09-13T11:08:58.009 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T11:08:58.010 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T11:08:58.010 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T11:08:58.012 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T11:08:58.012 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T11:08:58.014 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T11:08:58.017 INFO:teuthology.orchestra.run.smithi039.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T11:08:58.017 INFO:teuthology.orchestra.run.smithi039.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T11:08:58.020 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T11:08:58.034 INFO:teuthology.orchestra.run.smithi039.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4697-gd58f7306-1jammy [32.8 kB] 2024-09-13T11:08:58.036 INFO:teuthology.orchestra.run.smithi039.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4697-gd58f7306-1jammy [180 kB] 2024-09-13T11:08:58.040 INFO:teuthology.orchestra.run.smithi039.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4697-gd58f7306-1jammy [71.2 kB] 2024-09-13T11:08:58.042 INFO:teuthology.orchestra.run.smithi039.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4697-gd58f7306-1jammy [338 kB] 2024-09-13T11:08:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T11:08:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T11:08:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T11:08:58.082 INFO:teuthology.orchestra.run.smithi039.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T11:08:58.082 INFO:teuthology.orchestra.run.smithi039.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T11:08:58.083 INFO:teuthology.orchestra.run.smithi039.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4697-gd58f7306-1jammy [7,979 kB] 2024-09-13T11:08:58.084 INFO:teuthology.orchestra.run.smithi039.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T11:08:58.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T11:08:58.091 INFO:teuthology.orchestra.run.smithi039.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T11:08:58.160 INFO:teuthology.orchestra.run.smithi039.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T11:08:58.164 INFO:teuthology.orchestra.run.smithi039.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T11:08:58.165 INFO:teuthology.orchestra.run.smithi039.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T11:08:58.166 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T11:08:58.166 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4697-gd58f7306-1jammy [5,206 kB] 2024-09-13T11:08:58.167 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T11:08:58.176 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T11:08:58.183 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T11:08:58.185 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T11:08:58.187 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T11:08:58.198 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T11:08:58.199 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T11:08:58.207 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T11:08:58.242 INFO:teuthology.orchestra.run.smithi039.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T11:08:58.243 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4697-gd58f7306-1jammy [251 kB] 2024-09-13T11:08:58.246 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4697-gd58f7306-1jammy [124 kB] 2024-09-13T11:08:58.247 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4697-gd58f7306-1jammy [1,561 kB] 2024-09-13T11:08:58.248 INFO:teuthology.orchestra.run.smithi039.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T11:08:58.250 INFO:teuthology.orchestra.run.smithi039.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T11:08:58.252 INFO:teuthology.orchestra.run.smithi039.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T11:08:58.253 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T11:08:58.263 INFO:teuthology.orchestra.run.smithi039.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T11:08:58.264 INFO:teuthology.orchestra.run.smithi039.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T11:08:58.266 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4697-gd58f7306-1jammy [6,309 kB] 2024-09-13T11:08:58.272 INFO:teuthology.orchestra.run.smithi039.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T11:08:58.289 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T11:08:58.290 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T11:08:58.295 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T11:08:58.297 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T11:08:58.315 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T11:08:58.316 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T11:08:58.316 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T11:08:58.323 INFO:teuthology.orchestra.run.smithi039.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T11:08:58.325 INFO:teuthology.orchestra.run.smithi039.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T11:08:58.326 INFO:teuthology.orchestra.run.smithi039.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T11:08:58.340 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T11:08:58.341 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T11:08:58.398 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4697-gd58f7306-1jammy [23.1 MB] 2024-09-13T11:08:58.405 INFO:teuthology.orchestra.run.smithi039.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T11:08:58.407 INFO:teuthology.orchestra.run.smithi039.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T11:08:58.424 INFO:teuthology.orchestra.run.smithi039.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T11:08:58.424 INFO:teuthology.orchestra.run.smithi039.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T11:08:58.425 INFO:teuthology.orchestra.run.smithi039.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T11:08:58.430 INFO:teuthology.orchestra.run.smithi039.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T11:08:58.432 INFO:teuthology.orchestra.run.smithi039.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T11:08:58.479 INFO:teuthology.orchestra.run.smithi039.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4697-gd58f7306-1jammy [112 kB] 2024-09-13T11:08:58.487 INFO:teuthology.orchestra.run.smithi039.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4697-gd58f7306-1jammy [473 kB] 2024-09-13T11:08:58.520 INFO:teuthology.orchestra.run.smithi039.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4697-gd58f7306-1jammy [28.2 MB] 2024-09-13T11:08:58.987 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4697-gd58f7306-1jammy [14.1 kB] 2024-09-13T11:08:58.987 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4697-gd58f7306-1jammy [880 kB] 2024-09-13T11:08:59.001 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4697-gd58f7306-1jammy [2,433 kB] 2024-09-13T11:08:59.036 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4697-gd58f7306-1jammy [812 kB] 2024-09-13T11:08:59.045 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4697-gd58f7306-1jammy [160 kB] 2024-09-13T11:08:59.047 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4697-gd58f7306-1jammy [61.4 MB] 2024-09-13T11:08:59.894 INFO:teuthology.orchestra.run.smithi039.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4697-gd58f7306-1jammy [5,206 kB] 2024-09-13T11:09:00.029 INFO:teuthology.orchestra.run.smithi039.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4697-gd58f7306-1jammy [251 kB] 2024-09-13T11:09:00.070 INFO:teuthology.orchestra.run.smithi039.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4697-gd58f7306-1jammy [124 kB] 2024-09-13T11:09:00.073 INFO:teuthology.orchestra.run.smithi039.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4697-gd58f7306-1jammy [1,561 kB] 2024-09-13T11:09:00.139 INFO:teuthology.orchestra.run.smithi039.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4697-gd58f7306-1jammy [6,309 kB] 2024-09-13T11:09:00.408 INFO:teuthology.orchestra.run.smithi039.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4697-gd58f7306-1jammy [23.1 MB] 2024-09-13T11:09:00.953 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4697-gd58f7306-1jammy [8,625 kB] 2024-09-13T11:09:01.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4697-gd58f7306-1jammy [14.2 kB] 2024-09-13T11:09:01.116 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4697-gd58f7306-1jammy [55.7 MB] 2024-09-13T11:09:01.137 INFO:teuthology.orchestra.run.smithi039.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4697-gd58f7306-1jammy [14.1 kB] 2024-09-13T11:09:01.138 INFO:teuthology.orchestra.run.smithi039.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4697-gd58f7306-1jammy [880 kB] 2024-09-13T11:09:01.154 INFO:teuthology.orchestra.run.smithi039.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4697-gd58f7306-1jammy [2,433 kB] 2024-09-13T11:09:01.201 INFO:teuthology.orchestra.run.smithi039.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4697-gd58f7306-1jammy [812 kB] 2024-09-13T11:09:01.233 INFO:teuthology.orchestra.run.smithi039.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4697-gd58f7306-1jammy [160 kB] 2024-09-13T11:09:01.236 INFO:teuthology.orchestra.run.smithi039.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4697-gd58f7306-1jammy [61.4 MB] 2024-09-13T11:09:03.228 INFO:teuthology.orchestra.run.smithi102.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4697-gd58f7306-1jammy [130 kB] 2024-09-13T11:09:03.230 INFO:teuthology.orchestra.run.smithi102.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4697-gd58f7306-1jammy [38.9 kB] 2024-09-13T11:09:03.232 INFO:teuthology.orchestra.run.smithi102.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4697-gd58f7306-1jammy [15.9 MB] 2024-09-13T11:09:03.694 INFO:teuthology.orchestra.run.smithi102.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4697-gd58f7306-1jammy [91.3 kB] 2024-09-13T11:09:03.734 INFO:teuthology.orchestra.run.smithi039.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4697-gd58f7306-1jammy [8,625 kB] 2024-09-13T11:09:03.938 INFO:teuthology.orchestra.run.smithi039.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4697-gd58f7306-1jammy [14.2 kB] 2024-09-13T11:09:03.938 INFO:teuthology.orchestra.run.smithi039.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4697-gd58f7306-1jammy [55.7 MB] 2024-09-13T11:09:04.274 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 251 MB in 8s (33.0 MB/s) 2024-09-13T11:09:04.438 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T11:09:04.538 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T11:09:04.544 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T11:09:04.619 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T11:09:04.931 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T11:09:04.958 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T11:09:04.998 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T11:09:05.326 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T11:09:05.352 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T11:09:05.401 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T11:09:05.788 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T11:09:05.815 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T11:09:05.854 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:09:06.019 INFO:teuthology.orchestra.run.smithi039.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4697-gd58f7306-1jammy [130 kB] 2024-09-13T11:09:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4697-gd58f7306-1jammy [38.9 kB] 2024-09-13T11:09:06.023 INFO:teuthology.orchestra.run.smithi039.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4697-gd58f7306-1jammy [15.9 MB] 2024-09-13T11:09:06.232 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T11:09:06.259 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T11:09:06.299 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:09:06.511 INFO:teuthology.orchestra.run.smithi039.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-aclamk-cbt-combined/d58f73069a8157a9ace12a0247ee3e8497707ea9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4697-gd58f7306-1jammy [91.3 kB] 2024-09-13T11:09:06.636 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T11:09:06.662 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T11:09:06.702 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:09:07.030 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T11:09:07.056 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T11:09:07.097 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T11:09:07.104 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 251 MB in 10s (24.2 MB/s) 2024-09-13T11:09:07.277 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T11:09:07.368 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librados2. 2024-09-13T11:09:07.381 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-librados2_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:07.381 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T11:09:07.387 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T11:09:07.416 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:07.468 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T11:09:07.804 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T11:09:07.831 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T11:09:07.869 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librbd1. 2024-09-13T11:09:07.870 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T11:09:07.895 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-librbd1_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:07.961 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:08.165 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T11:09:08.181 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T11:09:08.215 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T11:09:08.363 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T11:09:08.390 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:08.422 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:08.661 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T11:09:08.665 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2024-09-13T11:09:08.688 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T11:09:08.692 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:08.732 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:08.736 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:09:09.051 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T11:09:09.078 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:09.118 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:09.130 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T11:09:09.157 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T11:09:09.379 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T11:09:09.405 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:09.422 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:09:09.446 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:09.707 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T11:09:09.722 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:09.757 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:09.809 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T11:09:09.835 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T11:09:09.875 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:09:10.026 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T11:09:10.053 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T11:09:10.093 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T11:09:10.278 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T11:09:10.305 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T11:09:10.353 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T11:09:10.413 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T11:09:10.438 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T11:09:10.479 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T11:09:10.740 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T11:09:10.755 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:10.756 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librados2. 2024-09-13T11:09:10.783 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../007-librados2_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:10.798 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:10.831 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librados2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:11.093 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T11:09:11.119 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T11:09:11.151 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T11:09:11.358 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librbd1. 2024-09-13T11:09:11.386 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../008-librbd1_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:11.395 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T11:09:11.410 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T11:09:11.433 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librbd1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:11.454 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T11:09:11.782 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T11:09:11.808 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T11:09:11.857 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T11:09:11.928 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T11:09:11.955 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:11.994 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:12.322 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rados. 2024-09-13T11:09:12.349 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:12.397 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rados (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:12.452 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua5.1. 2024-09-13T11:09:12.478 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T11:09:12.518 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T11:09:12.783 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T11:09:12.810 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:12.866 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-argparse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:12.988 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-any. 2024-09-13T11:09:13.003 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T11:09:13.047 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T11:09:13.169 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T11:09:13.196 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:13.244 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cephfs (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:13.291 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package zip. 2024-09-13T11:09:13.317 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T11:09:13.357 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T11:09:13.580 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T11:09:13.607 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:13.646 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:13.685 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package unzip. 2024-09-13T11:09:13.711 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T11:09:13.752 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T11:09:14.016 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T11:09:14.044 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T11:09:14.089 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package luarocks. 2024-09-13T11:09:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T11:09:14.115 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T11:09:14.147 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T11:09:14.494 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T11:09:14.521 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T11:09:14.522 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2024-09-13T11:09:14.548 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-librgw2_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:14.588 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:14.721 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T11:09:14.997 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T11:09:15.012 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:15.055 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rbd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:15.182 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T11:09:15.197 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:15.240 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:15.383 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T11:09:15.410 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T11:09:15.441 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T11:09:15.551 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T11:09:15.567 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T11:09:15.602 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T11:09:15.694 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T11:09:15.710 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T11:09:15.752 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T11:09:15.896 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T11:09:15.923 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:15.963 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:16.088 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T11:09:16.115 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T11:09:16.155 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T11:09:16.391 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2024-09-13T11:09:16.418 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:16.458 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:16.483 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua5.1. 2024-09-13T11:09:16.510 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T11:09:16.550 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T11:09:16.820 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua-any. 2024-09-13T11:09:16.835 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T11:09:16.878 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T11:09:17.130 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package zip. 2024-09-13T11:09:17.146 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T11:09:17.189 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T11:09:17.500 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package unzip. 2024-09-13T11:09:17.527 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T11:09:17.567 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T11:09:17.913 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2024-09-13T11:09:17.929 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package luarocks. 2024-09-13T11:09:17.940 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:17.956 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T11:09:17.987 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T11:09:17.989 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:18.328 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package librgw2. 2024-09-13T11:09:18.355 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../025-librgw2_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:18.386 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking librgw2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:18.551 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T11:09:18.577 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T11:09:18.617 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T11:09:18.920 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T11:09:18.946 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T11:09:18.980 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T11:09:18.987 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T11:09:19.007 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:19.047 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:19.306 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T11:09:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T11:09:19.364 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T11:09:19.400 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T11:09:19.427 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T11:09:19.466 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T11:09:19.692 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T11:09:19.719 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T11:09:19.759 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T11:09:19.895 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T11:09:19.922 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:19.961 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libradosstriper1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:20.054 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T11:09:20.080 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T11:09:20.120 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T11:09:20.314 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-common. 2024-09-13T11:09:20.341 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:20.364 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T11:09:20.380 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T11:09:20.380 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:20.414 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T11:09:20.692 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-portend. 2024-09-13T11:09:20.719 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T11:09:20.759 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T11:09:21.054 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T11:09:21.080 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T11:09:21.120 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T11:09:21.415 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T11:09:21.441 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T11:09:21.481 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T11:09:21.826 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T11:09:21.853 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T11:09:21.893 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T11:09:22.019 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-base. 2024-09-13T11:09:22.046 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:22.096 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-base (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:22.213 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T11:09:22.239 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T11:09:22.279 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T11:09:22.674 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T11:09:22.701 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T11:09:22.740 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T11:09:22.749 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T11:09:22.775 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T11:09:22.807 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T11:09:23.026 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T11:09:23.053 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T11:09:23.076 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2024-09-13T11:09:23.084 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T11:09:23.103 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T11:09:23.144 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T11:09:23.337 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T11:09:23.353 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T11:09:23.395 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T11:09:23.513 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T11:09:23.539 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T11:09:23.580 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T11:09:23.699 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T11:09:23.725 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T11:09:23.765 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T11:09:23.882 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T11:09:23.909 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T11:09:23.949 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T11:09:24.076 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T11:09:24.103 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T11:09:24.143 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T11:09:24.218 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2024-09-13T11:09:24.244 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T11:09:24.285 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T11:09:24.429 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T11:09:24.445 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T11:09:24.479 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T11:09:24.588 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T11:09:24.614 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T11:09:24.649 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T11:09:24.748 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-portend. 2024-09-13T11:09:24.777 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T11:09:24.889 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T11:09:24.932 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T11:09:24.959 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T11:09:24.999 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T11:09:25.203 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T11:09:25.230 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T11:09:25.269 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T11:09:25.302 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2024-09-13T11:09:25.328 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T11:09:25.368 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T11:09:25.573 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T11:09:25.599 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T11:09:25.639 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T11:09:25.671 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T11:09:25.687 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T11:09:25.730 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T11:09:25.909 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T11:09:25.925 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T11:09:25.967 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T11:09:26.033 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T11:09:26.059 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T11:09:26.099 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T11:09:26.271 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T11:09:26.298 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T11:09:26.337 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T11:09:26.385 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T11:09:26.412 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T11:09:26.452 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T11:09:26.640 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T11:09:26.668 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T11:09:26.707 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T11:09:26.721 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T11:09:26.748 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T11:09:26.780 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T11:09:26.985 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-mako. 2024-09-13T11:09:27.001 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T11:09:27.035 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T11:09:27.076 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T11:09:27.103 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T11:09:27.159 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T11:09:27.347 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T11:09:27.374 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T11:09:27.405 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T11:09:27.479 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-idna. 2024-09-13T11:09:27.505 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T11:09:27.546 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T11:09:27.708 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T11:09:27.735 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T11:09:27.774 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T11:09:27.840 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T11:09:27.866 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T11:09:27.915 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T11:09:28.086 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webob. 2024-09-13T11:09:28.113 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T11:09:28.152 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T11:09:28.252 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests. 2024-09-13T11:09:28.278 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T11:09:28.318 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T11:09:28.489 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T11:09:28.516 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T11:09:28.558 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T11:09:28.621 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T11:09:28.648 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T11:09:28.688 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T11:09:28.842 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T11:09:28.869 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T11:09:29.442 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T11:09:29.550 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T11:09:29.577 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:29.833 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:30.195 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-paste. 2024-09-13T11:09:30.221 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T11:09:30.222 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T11:09:30.248 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:30.262 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T11:09:30.288 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:30.532 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T11:09:30.548 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T11:09:30.582 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T11:09:30.599 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T11:09:30.625 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T11:09:30.665 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T11:09:30.901 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T11:09:30.928 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T11:09:30.943 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T11:09:30.968 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T11:09:30.969 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T11:09:31.026 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T11:09:31.255 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T11:09:31.282 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T11:09:31.321 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T11:09:31.354 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T11:09:31.381 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:31.421 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:31.632 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T11:09:31.659 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T11:09:31.699 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T11:09:31.816 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T11:09:31.843 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:31.882 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:32.063 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T11:09:32.090 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T11:09:32.129 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T11:09:32.457 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-idna. 2024-09-13T11:09:32.477 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T11:09:32.484 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T11:09:32.504 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:32.523 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T11:09:32.544 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:32.810 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T11:09:32.837 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T11:09:32.876 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T11:09:33.172 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests. 2024-09-13T11:09:33.199 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T11:09:33.230 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T11:09:33.483 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T11:09:33.510 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T11:09:33.549 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T11:09:33.680 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2024-09-13T11:09:33.696 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-ceph_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:33.738 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:33.844 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T11:09:33.871 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:33.903 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:34.066 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T11:09:34.093 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:34.133 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:34.266 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T11:09:34.293 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:34.332 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:34.503 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T11:09:34.530 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:34.569 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:34.602 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T11:09:34.618 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T11:09:34.652 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T11:09:34.939 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T11:09:34.947 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2024-09-13T11:09:34.963 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-cephadm_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:34.965 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T11:09:34.997 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:35.005 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T11:09:35.291 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T11:09:35.318 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T11:09:35.358 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T11:09:35.475 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T11:09:35.502 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:35.541 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:35.644 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T11:09:35.659 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T11:09:35.693 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T11:09:35.920 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T11:09:35.947 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:35.978 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mon (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:36.565 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T11:09:36.592 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:36.631 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-osd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:36.682 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-babel. 2024-09-13T11:09:36.710 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T11:09:36.749 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T11:09:37.043 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T11:09:37.071 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T11:09:37.110 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T11:09:37.413 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T11:09:37.440 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:37.479 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:37.726 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph. 2024-09-13T11:09:37.742 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../066-ceph_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:37.783 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T11:09:37.784 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:37.810 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T11:09:37.849 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T11:09:38.054 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T11:09:38.082 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:38.138 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:38.152 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2024-09-13T11:09:38.179 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T11:09:38.218 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T11:09:38.499 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T11:09:38.527 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:38.530 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T11:09:38.558 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:38.567 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mds (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:38.588 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:38.961 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package cephadm. 2024-09-13T11:09:38.988 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../069-cephadm_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:39.035 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:39.355 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T11:09:39.383 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T11:09:39.421 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T11:09:39.775 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T11:09:39.802 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T11:09:39.841 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T11:09:40.913 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-babel. 2024-09-13T11:09:40.940 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T11:09:40.979 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T11:09:41.285 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T11:09:41.291 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T11:09:41.303 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T11:09:41.318 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T11:09:41.343 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T11:09:41.349 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T11:09:41.660 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T11:09:41.677 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:41.710 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:41.796 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T11:09:41.824 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T11:09:41.856 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T11:09:42.031 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T11:09:42.058 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T11:09:42.097 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T11:09:42.219 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T11:09:42.246 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T11:09:42.285 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T11:09:42.333 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-routes. 2024-09-13T11:09:42.361 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T11:09:42.400 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T11:09:42.613 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T11:09:42.640 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T11:09:42.679 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T11:09:42.745 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T11:09:42.772 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:42.803 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:43.346 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T11:09:43.374 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:43.490 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:44.560 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T11:09:44.588 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T11:09:44.627 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T11:09:44.930 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T11:09:44.957 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T11:09:44.996 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T11:09:45.333 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T11:09:45.361 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T11:09:45.400 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T11:09:45.534 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T11:09:45.564 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T11:09:45.609 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T11:09:45.669 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T11:09:45.697 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T11:09:45.728 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T11:09:46.023 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T11:09:46.051 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T11:09:46.090 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T11:09:46.321 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T11:09:46.349 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T11:09:46.388 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T11:09:46.618 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T11:09:46.646 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T11:09:46.685 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T11:09:46.733 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T11:09:46.762 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T11:09:46.824 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T11:09:46.996 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T11:09:47.024 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T11:09:47.062 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T11:09:47.110 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T11:09:47.138 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T11:09:47.177 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T11:09:47.333 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T11:09:47.360 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T11:09:47.399 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T11:09:47.836 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T11:09:47.865 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:47.988 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:48.030 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T11:09:48.058 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:48.096 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:48.424 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T11:09:48.452 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T11:09:48.491 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T11:09:48.836 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T11:09:48.863 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T11:09:48.901 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T11:09:48.902 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T11:09:48.929 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T11:09:48.967 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T11:09:49.155 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2024-09-13T11:09:49.170 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T11:09:49.213 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T11:09:49.270 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T11:09:49.298 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T11:09:49.345 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T11:09:49.465 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2024-09-13T11:09:49.481 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T11:09:49.524 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T11:09:49.682 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T11:09:49.710 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T11:09:49.748 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T11:09:49.835 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T11:09:49.852 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T11:09:49.902 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T11:09:50.060 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T11:09:50.089 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T11:09:50.126 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T11:09:50.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2024-09-13T11:09:50.301 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:50.339 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:50.556 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T11:09:50.584 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T11:09:50.622 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T11:09:50.917 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T11:09:50.946 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T11:09:50.983 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T11:09:51.345 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T11:09:51.374 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T11:09:51.420 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T11:09:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T11:09:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T11:09:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T11:09:52.396 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T11:09:52.413 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:52.446 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:52.774 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T11:09:52.802 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T11:09:52.819 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T11:09:52.840 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T11:09:52.847 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:52.885 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:53.156 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T11:09:53.172 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:53.177 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T11:09:53.205 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T11:09:53.214 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:53.243 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T11:09:53.471 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package jq. 2024-09-13T11:09:53.488 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T11:09:53.521 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T11:09:53.533 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T11:09:53.550 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T11:09:53.592 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T11:09:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package socat. 2024-09-13T11:09:53.765 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T11:09:53.807 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T11:09:53.922 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T11:09:53.949 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T11:09:53.988 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T11:09:54.136 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T11:09:54.164 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T11:09:54.202 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T11:09:54.301 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T11:09:54.328 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T11:09:54.359 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T11:09:54.573 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-test. 2024-09-13T11:09:54.590 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:54.631 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-test (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:54.764 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pkg-config. 2024-09-13T11:09:54.792 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T11:09:54.830 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T11:09:55.100 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T11:09:55.116 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T11:09:55.158 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T11:09:55.587 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T11:09:55.615 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T11:09:55.653 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T11:09:55.900 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T11:09:55.925 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T11:09:55.956 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T11:09:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T11:09:56.279 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T11:09:56.309 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T11:09:56.620 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T11:09:56.648 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T11:09:56.687 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T11:09:56.998 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2024-09-13T11:09:57.026 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T11:09:57.064 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T11:09:57.186 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T11:09:57.214 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4697-gd58f7306-1jammy_all.deb ... 2024-09-13T11:09:57.252 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking ceph-volume (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:57.393 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T11:09:57.421 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T11:09:57.461 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T11:09:57.573 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T11:09:57.599 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:09:57.640 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libcephfs-dev (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:09:57.934 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T11:09:57.963 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T11:09:57.963 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T11:09:57.992 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T11:09:57.992 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T11:09:58.022 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T11:09:58.323 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T11:09:58.333 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-toml. 2024-09-13T11:09:58.351 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T11:09:58.361 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T11:09:58.389 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T11:09:58.399 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T11:09:58.711 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T11:09:58.739 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T11:09:58.760 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T11:09:58.777 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T11:09:58.788 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T11:09:58.826 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T11:09:59.114 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T11:09:59.142 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T11:09:59.180 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T11:09:59.257 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package pkg-config. 2024-09-13T11:09:59.286 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T11:09:59.323 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T11:09:59.458 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T11:09:59.486 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T11:09:59.525 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T11:09:59.568 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T11:09:59.586 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T11:09:59.626 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T11:10:00.063 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T11:10:00.091 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T11:10:00.121 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T11:10:00.262 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2024-09-13T11:10:00.291 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../116-radosgw_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:10:00.328 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:00.407 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T11:10:00.436 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T11:10:00.473 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T11:10:00.785 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T11:10:00.814 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T11:10:00.852 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T11:10:01.172 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T11:10:01.201 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T11:10:01.231 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T11:10:01.238 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T11:10:01.248 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:10:01.290 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:01.587 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T11:10:01.608 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-py. 2024-09-13T11:10:01.637 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T11:10:01.683 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T11:10:01.837 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T11:10:01.938 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T11:10:02.003 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T11:10:02.032 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T11:10:02.070 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T11:10:02.209 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T11:10:02.558 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T11:10:02.565 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T11:10:02.587 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T11:10:02.640 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T11:10:02.960 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-toml. 2024-09-13T11:10:02.989 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T11:10:02.991 INFO:teuthology.orchestra.run.smithi102.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T11:10:03.026 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T11:10:03.056 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:03.288 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T11:10:03.317 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T11:10:03.356 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T11:10:03.540 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2024-09-13T11:10:03.685 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T11:10:03.688 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T11:10:03.714 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T11:10:03.751 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T11:10:03.964 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T11:10:04.004 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T11:10:04.021 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T11:10:04.062 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T11:10:04.223 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T11:10:04.358 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T11:10:04.601 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T11:10:04.833 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package radosgw. 2024-09-13T11:10:04.862 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../116-radosgw_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:10:04.899 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking radosgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:05.069 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T11:10:05.187 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T11:10:05.472 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T11:10:05.819 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T11:10:05.847 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4697-gd58f7306-1jammy_amd64.deb ... 2024-09-13T11:10:05.885 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking rbd-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:05.907 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T11:10:06.167 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T11:10:06.189 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T11:10:06.435 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T11:10:06.457 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T11:10:06.558 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T11:10:06.694 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T11:10:06.808 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T11:10:06.954 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T11:10:07.136 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T11:10:07.213 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T11:10:07.472 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:07.567 INFO:teuthology.orchestra.run.smithi039.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T11:10:07.651 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:07.732 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T11:10:07.850 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T11:10:07.959 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T11:10:08.085 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T11:10:08.250 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user cephadm....done 2024-09-13T11:10:08.345 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T11:10:08.407 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T11:10:08.683 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T11:10:08.756 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T11:10:08.776 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T11:10:08.840 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T11:10:08.934 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T11:10:08.965 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T11:10:09.060 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T11:10:09.342 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T11:10:09.386 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T11:10:09.485 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T11:10:09.654 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T11:10:09.763 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T11:10:09.777 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T11:10:10.028 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T11:10:10.057 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T11:10:10.330 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T11:10:10.425 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T11:10:10.456 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T11:10:10.701 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T11:10:10.978 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T11:10:11.133 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T11:10:11.229 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T11:10:11.392 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T11:10:11.480 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T11:10:11.518 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T11:10:11.628 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T11:10:11.739 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T11:10:11.912 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T11:10:12.015 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-argparse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:12.288 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T11:10:12.291 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T11:10:12.526 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T11:10:12.539 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T11:10:12.860 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T11:10:12.908 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T11:10:12.986 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T11:10:13.225 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T11:10:13.245 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T11:10:13.577 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T11:10:13.641 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T11:10:13.685 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T11:10:13.748 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T11:10:13.820 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T11:10:13.874 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T11:10:13.946 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:14.239 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T11:10:14.259 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T11:10:14.385 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T11:10:14.557 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T11:10:14.669 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T11:10:14.945 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T11:10:15.238 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T11:10:15.339 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T11:10:15.721 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T11:10:15.981 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:10:16.033 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T11:10:16.115 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T11:10:16.292 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T11:10:16.375 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T11:10:16.418 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T11:10:16.484 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T11:10:16.544 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T11:10:16.594 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T11:10:16.845 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T11:10:16.878 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T11:10:17.121 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T11:10:17.229 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T11:10:17.372 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:10:17.480 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T11:10:17.498 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T11:10:17.800 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T11:10:17.882 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T11:10:18.051 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T11:10:18.183 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T11:10:18.294 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T11:10:18.535 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T11:10:18.537 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T11:10:18.785 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T11:10:18.788 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T11:10:18.912 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:19.047 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T11:10:19.173 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T11:10:19.213 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T11:10:19.449 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T11:10:19.522 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T11:10:19.584 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T11:10:19.885 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T11:10:20.161 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T11:10:20.421 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T11:10:20.547 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T11:10:20.673 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T11:10:20.736 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T11:10:20.763 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T11:10:20.979 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:10:21.017 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T11:10:21.097 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T11:10:21.134 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T11:10:21.373 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T11:10:21.499 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T11:10:21.511 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T11:10:21.625 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T11:10:21.762 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T11:10:21.888 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T11:10:21.942 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T11:10:22.147 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:10:22.210 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T11:10:22.273 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T11:10:22.478 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:10:22.579 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T11:10:22.599 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T11:10:22.889 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T11:10:22.893 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T11:10:23.153 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T11:10:23.156 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T11:10:23.278 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T11:10:23.424 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T11:10:23.554 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T11:10:23.684 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T11:10:23.838 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T11:10:23.943 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T11:10:24.175 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T11:10:24.227 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T11:10:24.345 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T11:10:24.527 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T11:10:24.629 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T11:10:24.738 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T11:10:24.795 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T11:10:25.023 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T11:10:25.122 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T11:10:25.249 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:25.324 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T11:10:25.375 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:25.494 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T11:10:25.609 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T11:10:25.734 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T11:10:25.831 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:25.860 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T11:10:25.950 INFO:teuthology.orchestra.run.smithi039.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T11:10:25.956 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:26.083 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T11:10:26.195 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T11:10:26.305 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T11:10:26.359 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:26.477 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:26.603 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:26.715 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T11:10:26.816 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T11:10:26.817 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T11:10:26.991 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T11:10:27.117 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T11:10:27.280 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:27.376 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T11:10:27.406 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:27.502 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T11:10:27.549 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:27.683 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T11:10:27.853 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T11:10:28.238 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T11:10:28.496 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T11:10:28.597 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T11:10:28.882 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T11:10:29.163 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:29.166 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T11:10:29.289 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:29.407 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:29.508 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:29.528 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T11:10:29.625 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:29.904 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T11:10:30.152 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2024-09-13T11:10:30.206 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T11:10:30.558 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T11:10:30.684 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librados2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:30.795 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2024-09-13T11:10:30.811 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:30.965 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2024-09-13T11:10:30.970 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T11:10:30.978 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T11:10:31.111 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T11:10:31.281 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:31.407 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libradosstriper1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:31.424 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T11:10:31.533 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T11:10:31.818 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librbd1 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:31.908 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:31.944 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-modules-core (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:32.061 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:32.179 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:32.265 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T11:10:32.265 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T11:10:32.646 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T11:10:32.646 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T11:10:32.746 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libcephfs-dev (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:32.872 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rados (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:32.973 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up librgw2 (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:33.099 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T11:10:33.147 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:33.497 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T11:10:33.965 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.164 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T11:10:34.164 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T11:10:34.369 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rbd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.495 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up rbd-fuse (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.621 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-rgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.642 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.738 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up python3-cephfs (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.848 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-common (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:34.861 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T11:10:34.862 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T11:10:35.344 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:35.390 INFO:teuthology.orchestra.run.smithi039.stdout:Adding group ceph....done 2024-09-13T11:10:35.597 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T11:10:35.597 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T11:10:35.750 INFO:teuthology.orchestra.run.smithi039.stdout:Adding system user ceph....done 2024-09-13T11:10:35.953 INFO:teuthology.orchestra.run.smithi039.stdout:Setting system user ceph properties....done 2024-09-13T11:10:35.973 INFO:teuthology.orchestra.run.smithi039.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T11:10:36.102 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:36.117 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T11:10:36.226 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:36.444 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:36.477 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T11:10:36.635 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T11:10:36.635 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T11:10:36.949 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-test (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:37.075 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up radosgw (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:37.114 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:37.333 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T11:10:37.535 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T11:10:37.551 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:37.796 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:38.244 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T11:10:38.324 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-base (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:38.362 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T11:10:38.514 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T11:10:38.767 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T11:10:39.239 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T11:10:39.240 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mds (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:39.483 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T11:10:39.484 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T11:10:39.899 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T11:10:39.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-09-13T11:10:39.967 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:40.002 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-13T11:10:40.201 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T11:10:40.201 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T11:10:40.213 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-13T11:10:40.214 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-13T11:10:40.416 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T11:10:40.416 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T11:10:40.416 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T11:10:40.416 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T11:10:40.417 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T11:10:40.417 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T11:10:40.417 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T11:10:40.418 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-13T11:10:40.418 INFO:teuthology.orchestra.run.smithi102.stdout: libsqlite3-0 2024-09-13T11:10:40.420 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-13T11:10:40.420 INFO:teuthology.orchestra.run.smithi102.stdout: sqlite3-doc 2024-09-13T11:10:40.448 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-13T11:10:40.448 INFO:teuthology.orchestra.run.smithi102.stdout: sqlite3 2024-09-13T11:10:40.449 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-09-13T11:10:40.450 INFO:teuthology.orchestra.run.smithi102.stdout: libsqlite3-0 2024-09-13T11:10:40.629 INFO:teuthology.orchestra.run.smithi102.stdout:1 upgraded, 1 newly installed, 0 to remove and 330 not upgraded. 2024-09-13T11:10:40.629 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 1,410 kB of archives. 2024-09-13T11:10:40.629 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-09-13T11:10:40.629 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-09-13T11:10:40.709 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-osd (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:41.030 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T11:10:41.030 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T11:10:41.193 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-09-13T11:10:41.528 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:41.628 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:41.651 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 1,410 kB in 1s (1,705 kB/s) 2024-09-13T11:10:41.754 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mon (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:41.869 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176250 files and directories currently installed.) 2024-09-13T11:10:41.874 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-13T11:10:41.970 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T11:10:41.970 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T11:10:42.036 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-09-13T11:10:42.365 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package sqlite3. 2024-09-13T11:10:42.382 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-13T11:10:42.423 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-13T11:10:42.447 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-cephadm (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:42.590 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:42.716 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-mgr-dashboard (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:42.766 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-09-13T11:10:42.867 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up ceph-volume (19.3.0-4697-gd58f7306-1jammy) ... 2024-09-13T11:10:42.869 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-13T11:10:42.996 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T11:10:43.253 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T11:10:43.362 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T11:10:44.003 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T11:10:44.088 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T11:10:44.520 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T11:10:44.525 DEBUG:teuthology.parallel:result is None 2024-09-13T11:10:45.052 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T11:10:45.682 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T11:10:45.684 DEBUG:teuthology.orchestra.run.smithi039:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-09-13T11:10:45.744 INFO:teuthology.orchestra.run.smithi039.stdout:Reading package lists... 2024-09-13T11:10:45.960 INFO:teuthology.orchestra.run.smithi039.stdout:Building dependency tree... 2024-09-13T11:10:45.960 INFO:teuthology.orchestra.run.smithi039.stdout:Reading state information... 2024-09-13T11:10:46.171 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T11:10:46.171 INFO:teuthology.orchestra.run.smithi039.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T11:10:46.171 INFO:teuthology.orchestra.run.smithi039.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T11:10:46.171 INFO:teuthology.orchestra.run.smithi039.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T11:10:46.172 INFO:teuthology.orchestra.run.smithi039.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T11:10:46.172 INFO:teuthology.orchestra.run.smithi039.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T11:10:46.172 INFO:teuthology.orchestra.run.smithi039.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T11:10:46.173 INFO:teuthology.orchestra.run.smithi039.stdout:The following additional packages will be installed: 2024-09-13T11:10:46.173 INFO:teuthology.orchestra.run.smithi039.stdout: libsqlite3-0 2024-09-13T11:10:46.175 INFO:teuthology.orchestra.run.smithi039.stdout:Suggested packages: 2024-09-13T11:10:46.175 INFO:teuthology.orchestra.run.smithi039.stdout: sqlite3-doc 2024-09-13T11:10:46.205 INFO:teuthology.orchestra.run.smithi039.stdout:The following NEW packages will be installed: 2024-09-13T11:10:46.205 INFO:teuthology.orchestra.run.smithi039.stdout: sqlite3 2024-09-13T11:10:46.206 INFO:teuthology.orchestra.run.smithi039.stdout:The following packages will be upgraded: 2024-09-13T11:10:46.207 INFO:teuthology.orchestra.run.smithi039.stdout: libsqlite3-0 2024-09-13T11:10:46.260 INFO:teuthology.orchestra.run.smithi039.stdout:1 upgraded, 1 newly installed, 0 to remove and 330 not upgraded. 2024-09-13T11:10:46.260 INFO:teuthology.orchestra.run.smithi039.stdout:Need to get 1,410 kB of archives. 2024-09-13T11:10:46.260 INFO:teuthology.orchestra.run.smithi039.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-09-13T11:10:46.261 INFO:teuthology.orchestra.run.smithi039.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-09-13T11:10:46.380 INFO:teuthology.orchestra.run.smithi039.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-09-13T11:10:46.760 INFO:teuthology.orchestra.run.smithi039.stdout:Fetched 1,410 kB in 0s (7,630 kB/s) 2024-09-13T11:10:47.023 INFO:teuthology.orchestra.run.smithi039.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176250 files and directories currently installed.) 2024-09-13T11:10:47.029 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-13T11:10:47.207 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-09-13T11:10:47.519 INFO:teuthology.orchestra.run.smithi039.stdout:Selecting previously unselected package sqlite3. 2024-09-13T11:10:47.548 INFO:teuthology.orchestra.run.smithi039.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-13T11:10:47.577 INFO:teuthology.orchestra.run.smithi039.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-13T11:10:48.080 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-09-13T11:10:48.206 INFO:teuthology.orchestra.run.smithi039.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-13T11:10:48.333 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T11:10:49.491 INFO:teuthology.orchestra.run.smithi039.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T11:10:49.931 INFO:teuthology.orchestra.run.smithi039.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T11:10:49.936 DEBUG:teuthology.parallel:result is None 2024-09-13T11:10:49.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T11:10:50.076 DEBUG:teuthology.orchestra.run.smithi039:> dpkg-query -W -f '${Version}' ceph 2024-09-13T11:10:50.095 INFO:teuthology.orchestra.run.smithi039.stdout:19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:10:50.096 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:10:50.096 INFO:teuthology.task.install:The correct ceph version 19.3.0-4697-gd58f7306-1jammy is installed. 2024-09-13T11:10:50.098 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T11:10:50.247 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2024-09-13T11:10:50.267 INFO:teuthology.orchestra.run.smithi102.stdout:19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:10:50.267 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4697-gd58f7306-1jammy 2024-09-13T11:10:50.267 INFO:teuthology.task.install:The correct ceph version 19.3.0-4697-gd58f7306-1jammy is installed. 2024-09-13T11:10:50.269 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T11:10:50.269 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:50.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T11:10:50.284 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:50.284 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T11:10:50.322 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T11:10:50.323 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:50.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T11:10:50.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T11:10:50.395 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:50.395 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T11:10:50.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T11:10:50.465 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T11:10:50.466 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:50.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T11:10:50.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T11:10:50.535 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:50.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T11:10:50.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T11:10:50.606 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T11:10:50.606 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:50.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T11:10:50.619 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T11:10:50.675 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:50.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T11:10:50.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T11:10:50.741 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T11:10:50.826 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T11:10:50.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2024-09-13T11:10:50.828 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-13T11:10:50.841 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T11:10:50.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T11:10:50.885 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T11:10:50.898 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T11:10:50.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T11:10:50.941 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T11:10:50.966 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T11:10:50.966 INFO:tasks.ceph:config {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T11:10:50.966 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394', 'branch': 'wip-aclamk-cbt-combined', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}', 'email': 'akupczyk@redhat.com', 'first_in_suite': False, 'job_id': '7903394', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-aclamk-cbt-combined'}, 'ceph': {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-aclamk-cbt-combined', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}}, 'owner': 'scheduled_akupczyk@teuthology', 'priority': 160, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5394, 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9', 'sleep_before_teardown': 0, 'subset': '582/12160', 'suite': 'rados', 'suite_branch': 'wip-aclamk-cbt-combined', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d58f73069a8157a9ace12a0247ee3e8497707ea9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9', 'targets': {'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBLsyjux9vrNGw/ofXKdk46PNwaIii1KAfpLvnWKzcNtyxEHZeAsHkX1xresYCTAy/nP673geRxPlsE9smVGEY=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFQsvYUdH4i1+Bn3HS7ZcEGmFYCEzmuIvx6yFLvFQ4AaJ4gBS8xwI1vlLhJKz86iRqn4WRscwVfsBF6rvo6I/Ts='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'd58f73069a8157a9ace12a0247ee3e8497707ea9'}}, {'ceph': None}, {'exec': {'client.0': ['ceph osd pool create cephsqlite', "ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring"]}}, {'exec': {'client.0': ['ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr']}}, {'workunit': {'clients': {'client.0': ['rados/test_libcephsqlite.sh cephsqlite']}, 'env': {'CEPH_ARGS': '--id libcephsqlite --no-log-to-stderr'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_09:37:56', 'tube': 'smithi', 'user': 'akupczyk', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T11:10:50.967 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T11:10:50.998 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T11:10:51.003 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T11:10:51.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T11:10:51.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:51.058 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T11:10:51.105 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T11:10:51.105 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 867 Links: 1 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-13 11:05:09.898669514 +0000 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-13 11:05:09.602672159 +0000 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-13 11:05:09.602672159 +0000 2024-09-13T11:10:51.157 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2024-09-13T11:10:51.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T11:10:51.212 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-13T11:10:51.212 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-13T11:10:51.212 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000571712 s, 896 kB/s 2024-09-13T11:10:51.213 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T11:10:51.261 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-09-13T11:10:51.308 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T11:10:51.308 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:51.308 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-09-13T11:10:51.309 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:51.309 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-13 11:05:10.166667121 +0000 2024-09-13T11:10:51.309 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-13 11:05:10.162667157 +0000 2024-09-13T11:10:51.309 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-13 11:05:10.162667157 +0000 2024-09-13T11:10:51.309 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2024-09-13T11:10:51.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T11:10:51.363 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-13T11:10:51.363 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-13T11:10:51.363 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000456804 s, 1.1 MB/s 2024-09-13T11:10:51.364 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T11:10:51.414 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-09-13T11:10:51.460 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T11:10:51.460 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:51.460 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-13T11:10:51.460 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:51.461 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-13 11:05:10.902660547 +0000 2024-09-13T11:10:51.461 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-13 11:05:10.650662798 +0000 2024-09-13T11:10:51.461 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-13 11:05:10.650662798 +0000 2024-09-13T11:10:51.461 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2024-09-13T11:10:51.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T11:10:51.515 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-13T11:10:51.515 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-13T11:10:51.515 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000477926 s, 1.1 MB/s 2024-09-13T11:10:51.516 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T11:10:51.566 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-09-13T11:10:51.612 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T11:10:51.612 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:51.613 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-09-13T11:10:51.613 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:51.613 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-09-13 11:05:11.378656296 +0000 2024-09-13T11:10:51.613 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-09-13 11:05:11.126658547 +0000 2024-09-13T11:10:51.613 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-09-13 11:05:11.126658547 +0000 2024-09-13T11:10:51.613 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: - 2024-09-13T11:10:51.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T11:10:51.668 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-09-13T11:10:51.668 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-09-13T11:10:51.669 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000475884 s, 1.1 MB/s 2024-09-13T11:10:51.669 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T11:10:51.718 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T11:10:51.719 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:51.719 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T11:10:51.724 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T11:10:51.724 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-13T11:10:51.771 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T11:10:51.771 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:51.771 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-13T11:10:51.771 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:51.772 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 11:05:04.146151908 +0000 2024-09-13T11:10:51.772 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 11:05:04.142151944 +0000 2024-09-13T11:10:51.772 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 11:05:04.142151944 +0000 2024-09-13T11:10:51.772 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-13T11:10:51.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T11:10:51.825 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T11:10:51.826 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T11:10:51.826 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000435186 s, 1.2 MB/s 2024-09-13T11:10:51.827 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T11:10:51.876 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-13T11:10:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T11:10:51.922 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:51.923 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-13T11:10:51.923 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:51.923 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 11:05:04.886145298 +0000 2024-09-13T11:10:51.923 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 11:05:04.630147585 +0000 2024-09-13T11:10:51.923 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 11:05:04.630147585 +0000 2024-09-13T11:10:51.923 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-13T11:10:51.923 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T11:10:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T11:10:51.977 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T11:10:51.978 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000423177 s, 1.2 MB/s 2024-09-13T11:10:51.979 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T11:10:52.027 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 11:05:05.386140832 +0000 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 11:05:05.130143119 +0000 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 11:05:05.130143119 +0000 2024-09-13T11:10:52.075 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-13T11:10:52.076 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T11:10:52.129 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T11:10:52.129 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T11:10:52.129 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000374232 s, 1.4 MB/s 2024-09-13T11:10:52.130 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T11:10:52.180 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-13 11:05:05.858136617 +0000 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-13 11:05:05.614138796 +0000 2024-09-13T11:10:52.230 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-13 11:05:05.614138796 +0000 2024-09-13T11:10:52.231 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-13T11:10:52.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T11:10:52.285 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-13T11:10:52.285 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-13T11:10:52.285 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000367768 s, 1.4 MB/s 2024-09-13T11:10:52.286 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T11:10:52.336 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T11:10:52.336 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T11:10:52.336 INFO:tasks.ceph:Generating config... 2024-09-13T11:10:52.337 INFO:tasks.ceph:[client] debug cephsqlite = 20 2024-09-13T11:10:52.337 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T11:10:52.337 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T11:10:52.337 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-13T11:10:52.337 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-13T11:10:52.337 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-13T11:10:52.337 INFO:tasks.ceph:[global] ms type = async 2024-09-13T11:10:52.337 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-13T11:10:52.338 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-13T11:10:52.338 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-09-13T11:10:52.338 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-09-13T11:10:52.338 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] bluestore write v2 = True 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T11:10:52.339 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T11:10:52.340 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-13T11:10:52.341 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-13T11:10:52.341 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T11:10:52.342 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T11:10:52.378 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T11:10:52.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T11:10:52.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T11:10:52.524 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.c', '[v2:172.21.15.39:3301,v1:172.21.15.39:6790]'), ('mon.b', '172.21.15.102')] 2024-09-13T11:10:52.525 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790],172.21.15.102', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-13T11:10:52.526 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:52.526 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T11:10:52.573 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.39 --addv c '[v2:172.21.15.39:3301,v1:172.21.15.39:6790]' --add b 172.21.15.102 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:10:52.662 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:10:52.662 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid 14a7ff11-8012-4cb4-a474-c65ae9644761 2024-09-13T11:10:52.662 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-09-13T11:10:52.662 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2024-09-13T11:10:52.662 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 14a7ff11-8012-4cb4-a474-c65ae9644761 2024-09-13T11:10:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2024-09-13T11:10:52.662749+0000 2024-09-13T11:10:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-09-13T11:10:52.662749+0000 2024-09-13T11:10:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 17 (quincy) 2024-09-13T11:10:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:election_strategy: 3 2024-09-13T11:10:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-09-13T11:10:52.663 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-13T11:10:52.664 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] mon.c 2024-09-13T11:10:52.664 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T11:10:52.668 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T11:10:52.673 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 14a7ff11-8012-4cb4-a474-c65ae9644761... 2024-09-13T11:10:52.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T11:10:52.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.745 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2024-09-13T11:10:52.746 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T11:10:52.747 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790],172.21.15.102" 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon client directed command retry = 5 2024-09-13T11:10:52.748 INFO:teuthology.orchestra.run.smithi039.stdout: mon election default strategy = 3 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: ms inject socket failures = 5000 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: ms type = async 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 14a7ff11-8012-4cb4-a474-c65ae9644761 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: osd mclock profile = high_recovery_ops 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2024-09-13T11:10:52.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug trim objects = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.750 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bluefs allocator = hybrid 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore allocator = hybrid 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore write v2 = True 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore zero block detection = True 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 20 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 20 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-13T11:10:52.751 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 10 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify cached snaps = True 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify missing on start = True 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd mclock override recovery settings = True 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd op queue = debug_random 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd op queue cut off = debug_random 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: osd shutdown pgref assert = True 2024-09-13T11:10:52.752 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-09-13T11:10:52.753 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T11:10:52.754 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon min osdmap epochs = 50 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon osdmap full prune interval = 2 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon osdmap full prune min = 15 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon osdmap full prune txsize = 2 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: mon scrub interval = 300 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: paxos service trim min = 10 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2024-09-13T11:10:52.755 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout: debug cephsqlite = 20 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2024-09-13T11:10:52.756 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.758 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-13T11:10:52.759 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-13T11:10:52.760 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.39,[v2:172.21.15.39:3301,v1:172.21.15.39:6790],172.21.15.102" 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: mon client directed command retry = 5 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: mon election default strategy = 3 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: ms inject socket failures = 5000 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: ms type = async 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 14a7ff11-8012-4cb4-a474-c65ae9644761 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-13T11:10:52.761 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-13T11:10:52.762 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-13T11:10:52.763 INFO:teuthology.orchestra.run.smithi102.stdout: bluefs allocator = hybrid 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = hybrid 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore write v2 = True 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore zero block detection = True 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-13T11:10:52.764 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify cached snaps = True 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify missing on start = True 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock override recovery settings = True 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd op queue = debug_random 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd op queue cut off = debug_random 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: osd shutdown pgref assert = True 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-13T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-13T11:10:52.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-13T11:10:52.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon min osdmap epochs = 50 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon osdmap full prune interval = 2 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon osdmap full prune min = 15 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon osdmap full prune txsize = 2 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon scrub interval = 300 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: paxos service trim min = 10 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T11:10:52.768 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T11:10:52.769 INFO:teuthology.orchestra.run.smithi102.stdout: debug cephsqlite = 20 2024-09-13T11:10:52.769 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-13T11:10:52.769 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-13T11:10:52.769 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-13T11:10:52.769 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-13T11:10:52.769 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-13T11:10:52.769 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T11:10:52.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T11:10:52.854 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T11:10:52.855 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:52.855 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T11:10:52.860 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:52.860 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T11:10:52.908 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:10:52.908 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:52.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T11:10:52.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T11:10:52.977 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:10:52.977 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:10:53.024 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:10:53.025 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:53.025 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T11:10:53.025 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T11:10:53.047 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:10:53.047 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:10:53.095 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T11:10:53.095 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T11:10:53.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T11:10:53.143 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T11:10:53.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T11:10:53.189 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T11:10:53.201 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T11:10:53.201 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T11:10:53.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T11:10:53.238 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T11:10:53.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T11:10:53.288 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T11:10:53.300 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T11:10:53.300 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T11:10:53.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T11:10:53.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T11:10:53.314 INFO:tasks.ceph:role: osd.0 2024-09-13T11:10:53.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:10:53.314 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T11:10:53.397 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:10:53.398 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:10:54.675 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-13T11:10:54.677 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-13T11:10:54.677 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T11:10:54.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T11:10:54.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:10:54.790 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:10:54.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T11:10:54.846 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T11:10:54.846 INFO:tasks.ceph:role: osd.1 2024-09-13T11:10:54.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:10:54.847 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:10:54.929 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:10:54.930 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:10:54.930 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:10:54.930 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:10:56.225 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-13T11:10:56.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-13T11:10:56.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T11:10:56.288 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T11:10:56.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:10:56.341 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:10:56.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T11:10:56.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T11:10:56.397 INFO:tasks.ceph:role: osd.2 2024-09-13T11:10:56.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:10:56.397 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T11:10:56.486 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:10:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:10:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:10:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:10:56.486 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:10:56.486 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:10:56.487 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:10:56.487 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:10:56.487 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:10:56.487 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:10:57.784 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-13T11:10:57.787 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-13T11:10:57.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T11:10:57.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T11:10:57.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:10:57.899 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:10:57.899 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T11:10:57.953 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T11:10:57.953 INFO:tasks.ceph:role: osd.3 2024-09-13T11:10:57.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:10:57.953 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T11:10:58.037 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:10:58.038 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:10:59.315 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-09-13T11:10:59.317 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-09-13T11:10:59.318 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T11:10:59.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T11:10:59.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:10:59.433 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:10:59.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:10:59.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:10:59.556+0000 7fbd085357c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T11:10:59.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:10:59.556+0000 7fbd085357c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T11:10:59.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:10:59.560+0000 7fbd085357c0 -1 bdev(0x55804e937800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T11:10:59.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:10:59.560+0000 7fbd085357c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T11:11:02.738 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T11:11:02.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:02.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:02.836+0000 7faeaba0e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T11:11:02.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:02.836+0000 7faeaba0e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T11:11:02.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:02.836+0000 7faeaba0e7c0 -1 bdev(0x55625f765800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:02.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:02.836+0000 7faeaba0e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T11:11:05.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T11:11:06.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:06.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:06.104+0000 7f01e871f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T11:11:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:06.108+0000 7f01e871f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T11:11:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:06.108+0000 7f01e871f7c0 -1 bdev(0x5609a4e77800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:06.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:06.108+0000 7f01e871f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T11:11:09.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T11:11:09.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:09.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:09.384+0000 7f811240a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T11:11:09.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:09.384+0000 7f811240a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T11:11:09.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:09.384+0000 7f811240a7c0 -1 bdev(0x55e473335800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:09.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:09.384+0000 7f811240a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T11:11:12.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T11:11:12.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T11:11:12.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T11:11:12.630 INFO:tasks.ceph:role: osd.4 2024-09-13T11:11:12.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:11:12.631 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T11:11:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:11:12.694 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:11:12.694 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:11:12.694 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:11:12.694 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:11:12.694 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:11:12.695 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:11:12.695 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:11:12.695 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:11:12.695 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:11:13.147 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T11:11:13.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T11:11:13.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T11:11:13.276 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T11:11:13.285 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:11:13.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:11:13.286 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T11:11:13.339 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T11:11:13.340 INFO:tasks.ceph:role: osd.5 2024-09-13T11:11:13.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:11:13.340 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:11:13.402 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:11:13.403 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:11:13.403 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:11:13.834 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T11:11:13.836 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T11:11:13.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T11:11:13.904 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T11:11:13.954 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:11:13.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:11:13.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T11:11:14.008 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T11:11:14.008 INFO:tasks.ceph:role: osd.6 2024-09-13T11:11:14.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:11:14.008 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T11:11:14.069 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:11:14.070 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:11:14.535 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T11:11:14.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T11:11:14.537 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T11:11:14.621 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T11:11:14.674 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:11:14.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:11:14.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T11:11:14.730 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T11:11:14.731 INFO:tasks.ceph:role: osd.7 2024-09-13T11:11:14.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:11:14.731 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T11:11:14.794 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T11:11:14.795 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T11:11:15.276 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-13T11:11:15.278 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-13T11:11:15.278 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T11:11:15.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T11:11:15.429 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T11:11:15.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:11:15.430 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:15.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:15.550+0000 7f234956f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T11:11:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:15.554+0000 7f234956f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T11:11:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:15.554+0000 7f234956f7c0 -1 bdev(0x55d2e7dbd800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:15.554+0000 7f234956f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T11:11:18.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T11:11:18.736 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:18.814+0000 7ff8679067c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T11:11:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:18.814+0000 7ff8679067c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T11:11:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:18.814+0000 7ff8679067c0 -1 bdev(0x55c5adb7b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:18.814+0000 7ff8679067c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T11:11:21.980 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T11:11:22.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:22.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:22.114+0000 7f86dea437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T11:11:22.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:22.114+0000 7f86dea437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T11:11:22.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:22.114+0000 7f86dea437c0 -1 bdev(0x55d48489b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:22.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:22.118+0000 7f86dea437c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T11:11:25.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T11:11:25.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:25.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:25.390+0000 7f00784987c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T11:11:25.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:25.394+0000 7f00784987c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T11:11:25.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:25.394+0000 7f00784987c0 -1 bdev(0x55acf7753800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-13T11:11:25.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:25.394+0000 7f00784987c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T11:11:28.548 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T11:11:28.603 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T11:11:28.603 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:28.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T11:11:28.618 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:28.618 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T11:11:28.673 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:28.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T11:11:28.728 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:28.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T11:11:28.784 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:28.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T11:11:28.840 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:28.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T11:11:28.853 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:28.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T11:11:28.909 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:28.909 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T11:11:28.965 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:28.965 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T11:11:29.021 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:29.022 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T11:11:29.077 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:29.078 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T11:11:29.084 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:29.084 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T11:11:29.126 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T11:11:29.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T11:11:29.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQC9HeRm2nePCBAAV/A4jpJ0XnS+qW93E8YczA== 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDDHeRmPAZeIRAAGJEAe+ZRW1DztqgP4v9OsQ== 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDGHeRmpMrvMRAA47+GQXdjD7Cs9/lDSykzNA== 2024-09-13T11:11:29.172 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDKHeRmkAx6BhAAkrgyMWO4+/OSDBIHZVIDeQ== 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDNHeRmKu4BFxAA9EqQN8WpcjgEfW8t9JNsvg== 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQC9HeRmSkBgCxAA0a9JlgTXxeqdiK7wWrwSKQ== 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDTHeRmPorrIBAADQh1xzUroHGCgsDRGUNvGw== 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDWHeRmLPi3MBAAzbcPMx6YrJIGe/A/ythtIw== 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDaHeRmSJ4KBxAAn9fy95DeCyfA0aRwsCaBHg== 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2024-09-13T11:11:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQDdHeRmEY6AFxAA3XopMaBWIvrLfdqA6ycx6A== 2024-09-13T11:11:29.174 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-09-13T11:11:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQC9HeRmx0ZLDhAA+bWccy4aHvmxL9UUseuwKA== 2024-09-13T11:11:29.174 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2024-09-13T11:11:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQC9HeRmVMwvERAAjMTU/l0nc7KepjHziIha6Q== 2024-09-13T11:11:29.180 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-09-13T11:11:29.180 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC9HeRm2nePCBAAV/A4jpJ0XnS+qW93E8YczA== 2024-09-13T11:11:29.180 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-09-13T11:11:29.180 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDDHeRmPAZeIRAAGJEAe+ZRW1DztqgP4v9OsQ== 2024-09-13T11:11:29.180 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDGHeRmpMrvMRAA47+GQXdjD7Cs9/lDSykzNA== 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDKHeRmkAx6BhAAkrgyMWO4+/OSDBIHZVIDeQ== 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDNHeRmKu4BFxAA9EqQN8WpcjgEfW8t9JNsvg== 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC9HeRmSkBgCxAA0a9JlgTXxeqdiK7wWrwSKQ== 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-09-13T11:11:29.181 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDTHeRmPorrIBAADQh1xzUroHGCgsDRGUNvGw== 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDWHeRmLPi3MBAAzbcPMx6YrJIGe/A/ythtIw== 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDaHeRmSJ4KBxAAn9fy95DeCyfA0aRwsCaBHg== 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQDdHeRmEY6AFxAA3XopMaBWIvrLfdqA6ycx6A== 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC9HeRmx0ZLDhAA+bWccy4aHvmxL9UUseuwKA== 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-09-13T11:11:29.182 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQC9HeRmVMwvERAAjMTU/l0nc7KepjHziIha6Q== 2024-09-13T11:11:29.183 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T11:11:29.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T11:11:29.271 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.274 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.316 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.400 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.405 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.489 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T11:11:29.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T11:11:29.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.869 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T11:11:29.944 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T11:11:29.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T11:11:30.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T11:11:30.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T11:11:30.111 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T11:11:30.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T11:11:30.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T11:11:30.251 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T11:11:30.263 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T11:11:30.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T11:11:30.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T11:11:30.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T11:11:30.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T11:11:30.546 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T11:11:30.556 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:30.558 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T11:11:30.601 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T11:11:30.602 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T11:11:30.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T11:11:30.605 INFO:tasks.ceph.mon.a:Started 2024-09-13T11:11:30.605 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T11:11:30.605 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T11:11:30.607 INFO:tasks.ceph.mon.c:Started 2024-09-13T11:11:30.608 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T11:11:30.608 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T11:11:30.646 INFO:tasks.ceph.mon.b:Started 2024-09-13T11:11:30.647 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T11:11:30.647 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T11:11:30.647 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T11:11:30.649 INFO:tasks.ceph.mgr.y:Started 2024-09-13T11:11:30.649 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T11:11:30.650 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T11:11:30.651 INFO:tasks.ceph.mgr.x:Started 2024-09-13T11:11:30.651 DEBUG:tasks.ceph:set 0 configs 2024-09-13T11:11:30.652 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T11:11:30.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T11:11:30.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.764+0000 7f970b8fa640 1 Processor -- start 2024-09-13T11:11:30.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.764+0000 7f970b8fa640 1 -- start start 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f970b8fa640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f970b8fa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f970b8fa640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97040b0440 con 0x7f970406cba0 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f970b8fa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f97040b0610 con 0x7f97040b15d0 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f970b8fa640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f970406cf80 con 0x7f9704144850 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709696640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f970406cba0 0x7f97040afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:35154/0 (socket says 172.21.15.39:35154) 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 learned_addr learned my addr 172.21.15.39:0/1602173222 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:30.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:30.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T11:11:30.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:30.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T11:11:30.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:30.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:30.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.768+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T11:11:30.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:30.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T11:11:30.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:30.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:30.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T11:11:30.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:30.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T11:11:30.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:30.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:30.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:30.972+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T11:11:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T11:11:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T11:11:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:31.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T11:11:31.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:31.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:31.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:31.376+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T11:11:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T11:11:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:32.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:32.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:32.180+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T11:11:33.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9704144850 0x7f97040aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f97040af330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f97040af330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 >> v1:172.21.15.39:6789/0 conn(0x7f970406cba0 legacy=0x7f97040afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97040b08c0 con 0x7f96e80036f0 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f97040b0610 con 0x7f96e8007360 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:33.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T11:11:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.972+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T11:11:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.972+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:33.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T11:11:34.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:34.376+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:34.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:34.376+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T11:11:34.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:34.376+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:34.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:34.376+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:34.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:34.376+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T11:11:35.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:35.180+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:35.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:35.180+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T11:11:35.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:35.180+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:35.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:35.180+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:35.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:35.180+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 msgr2=0x7f96e8009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e8007360 0x7f96e8009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 >> v1:172.21.15.102:6789/0 conn(0x7f96e80036f0 legacy=0x7f96e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 reap_dead start 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e800aee0 con 0x7f96e80098e0 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f97040b0610 con 0x7f96e800a570 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f96faffd640 1 -- 172.21.15.39:0/1602173222 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f96e80064a0 con 0x7f97040b15d0 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:36.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 msgr2=0x7f96e800a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 msgr2=0x7f96e800a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f96e800a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f96e800a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T11:11:36.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.768+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T11:11:36.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:36.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 msgr2=0x7f96e800a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9708e95640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 msgr2=0x7f96e800a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f96e800a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f96e800a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T11:11:36.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:36.972+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T11:11:37.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000658302 0 0) 0x7f96e800aee0 con 0x7f96e80098e0 2024-09-13T11:11:37.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96f0003530 con 0x7f96e80098e0 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 97062941 0 0) 0x7f96f0003530 con 0x7f96e80098e0 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 msgr2=0x7f96e800a030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.102:3300/0 conn(0x7f97040b15d0 0x7f96e800a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 msgr2=0x7f96e800a950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 --2- 172.21.15.39:0/1602173222 >> v2:172.21.15.39:3300/0 conn(0x7f96e800a570 0x7f96e800a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e80066a0 con 0x7f96e80098e0 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f96fc009990 con 0x7f96e80098e0 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 >> v1:172.21.15.39:6789/0 conn(0x7f96e80098e0 legacy=0x7f96e8005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f96f0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96f0004810 0x7f96f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f96f00052f0 0x7f96f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f97040b0610 con 0x7f96f0003a10 2024-09-13T11:11:37.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96e80064a0 con 0x7f96f0004810 2024-09-13T11:11:37.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f96f000c240 con 0x7f96f00052f0 2024-09-13T11:11:37.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f96f0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9708e95640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96f0004810 0x7f96f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709e97640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f96f00052f0 0x7f96f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f96f00052f0 msgr2=0x7f96f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:37.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f96f00052f0 0x7f96f000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96f0004810 msgr2=0x7f96f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:37.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96f0004810 0x7f96f0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709696640 1 -- 172.21.15.39:0/1602173222 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f0003530 con 0x7f96f0003a10 2024-09-13T11:11:37.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.020+0000 7f9709e97640 1 -- 172.21.15.39:0/1602173222 reap_dead start 2024-09-13T11:11:37.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f9709696640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f96f0003e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9700007050 tx=0x7f970001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa48fba711e1ef22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:37.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97000ab070 con 0x7f96f0003a10 2024-09-13T11:11:37.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97000a58f0 con 0x7f96f0003a10 2024-09-13T11:11:37.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f96fbfff640 1 -- 172.21.15.39:0/1602173222 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700005c30 con 0x7f96f0003a10 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 -- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 msgr2=0x7f96f0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f96f0003e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9700007050 tx=0x7f970001c940 comp rx=0 tx=0).stop 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 -- 172.21.15.39:0/1602173222 shutdown_connections 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 --2- 172.21.15.39:0/1602173222 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f96f0003e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 -- 172.21.15.39:0/1602173222 >> 172.21.15.39:0/1602173222 conn(0x7f97040b6090 msgr2=0x7f97040b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 -- 172.21.15.39:0/1602173222 shutdown_connections 2024-09-13T11:11:37.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.028+0000 7f970b8fa640 1 -- 172.21.15.39:0/1602173222 wait complete. 2024-09-13T11:11:37.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.032+0000 7f970b8fa640 1 Processor -- start 2024-09-13T11:11:37.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.032+0000 7f970b8fa640 1 -- start start 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f97040ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 0x7f9704072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97041d82d0 0x7f97041d8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f97040b0d70 con 0x7f96f0003a10 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9704074b70 con 0x7f97041d82d0 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f97040afd30 con 0x7f97041dc420 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9708e95640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 0x7f9704072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f97040ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9708e95640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 0x7f9704072f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53178/0 (socket says 172.21.15.39:53178) 2024-09-13T11:11:37.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f97040ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33238/0 (socket says 172.21.15.39:33238) 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9708e95640 1 -- 172.21.15.39:0/2909300328 learned_addr learned my addr 172.21.15.39:0/2909300328 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709e97640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97041d82d0 0x7f97041d8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 -- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 msgr2=0x7f9704072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 0x7f9704072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 -- 172.21.15.39:0/2909300328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97041d82d0 msgr2=0x7f97041d8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97041d82d0 0x7f97041d8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 -- 172.21.15.39:0/2909300328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97040ae430 con 0x7f96f0003a10 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9708e95640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 0x7f9704072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f9709696640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f97040ae850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c190 tx=0x7f96f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97000ab040 con 0x7f96f0003a10 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97000a56d0 con 0x7f96f0003a10 2024-09-13T11:11:37.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700005c30 con 0x7f96f0003a10 2024-09-13T11:11:37.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97041dbf00 con 0x7f96f0003a10 2024-09-13T11:11:37.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970413c3a0 con 0x7f96f0003a10 2024-09-13T11:11:37.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f97000053d0 con 0x7f96f0003a10 2024-09-13T11:11:37.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f97000c36c0 con 0x7f96f0003a10 2024-09-13T11:11:37.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.036+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97041dbd30 con 0x7f96f0003a10 2024-09-13T11:11:37.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.056+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9700016730 con 0x7f96f0003a10 2024-09-13T11:11:37.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.120+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f97041dbd30 con 0x7f96f0003a10 2024-09-13T11:11:37.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f96f9ffb640 1 -- 172.21.15.39:0/2909300328 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f97000a5880 con 0x7f96f0003a10 2024-09-13T11:11:37.133 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-09-13T11:11:37.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 msgr2=0x7f97040ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f97040ae850 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c190 tx=0x7f96f0005840 comp rx=0 tx=0).stop 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 shutdown_connections 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97041d82d0 0x7f97041d8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97041dc420 0x7f9704072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 --2- 172.21.15.39:0/2909300328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96f0003a10 0x7f97040ae850 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 >> 172.21.15.39:0/2909300328 conn(0x7f97040b6090 msgr2=0x7f97040aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 shutdown_connections 2024-09-13T11:11:37.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:37.132+0000 7f970b8fa640 1 -- 172.21.15.39:0/2909300328 wait complete. 2024-09-13T11:11:37.155 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T11:11:37.155 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T11:11:37.155 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:37.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T11:11:37.166 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:37.166 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T11:11:37.217 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:37.217 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T11:11:37.269 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:11:37.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T11:11:37.322 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:37.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T11:11:37.336 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:37.336 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T11:11:37.390 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:37.390 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T11:11:37.445 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-13T11:11:37.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T11:11:37.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new a629f7f1-92ab-4d94-ba61-c62fa852306e 0 2024-09-13T11:11:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 Processor -- start 2024-09-13T11:11:37.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 -- start start 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200b1b20 0x7fe920137690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe920072bc0 0x7fe920137bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9200747d0 con 0x7fe9200727e0 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe920074ab0 con 0x7fe920072bc0 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.662+0000 7fe9278bb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe92013edc0 con 0x7fe9200b1b20 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe920072bc0 0x7fe920137bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe920072bc0 0x7fe920137bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48380/0 (socket says 172.21.15.102:48380) 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 -- 172.21.15.102:0/3354946501 learned_addr learned my addr 172.21.15.102:0/3354946501 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe924e56640 1 --2- 172.21.15.102:0/3354946501 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200b1b20 0x7fe920137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 -- 172.21.15.102:0/3354946501 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200b1b20 msgr2=0x7fe920137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 --2- 172.21.15.102:0/3354946501 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200b1b20 0x7fe920137690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 -- 172.21.15.102:0/3354946501 >> v1:172.21.15.39:6789/0 conn(0x7fe9200727e0 legacy=0x7fe920141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 -- 172.21.15.102:0/3354946501 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe920141fa0 con 0x7fe920072bc0 2024-09-13T11:11:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe925e58640 1 --2- 172.21.15.102:0/3354946501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe920137bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009e50 tx=0x7fe91c01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7402479cb37c26d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe917fff640 1 -- 172.21.15.102:0/3354946501 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0a57f0 con 0x7fe920072bc0 2024-09-13T11:11:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe917fff640 1 -- 172.21.15.102:0/3354946501 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91c0a5990 con 0x7fe920072bc0 2024-09-13T11:11:37.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe917fff640 1 -- 172.21.15.102:0/3354946501 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0a5d60 con 0x7fe920072bc0 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 -- 172.21.15.102:0/3354946501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 msgr2=0x7fe920137bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 --2- 172.21.15.102:0/3354946501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe920137bd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009e50 tx=0x7fe91c01ca10 comp rx=0 tx=0).stop 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 -- 172.21.15.102:0/3354946501 shutdown_connections 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 --2- 172.21.15.102:0/3354946501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe920137bd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 --2- 172.21.15.102:0/3354946501 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200b1b20 0x7fe920137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 -- 172.21.15.102:0/3354946501 >> 172.21.15.102:0/3354946501 conn(0x7fe920068890 msgr2=0x7fe920068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 -- 172.21.15.102:0/3354946501 shutdown_connections 2024-09-13T11:11:37.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.666+0000 7fe9278bb640 1 -- 172.21.15.102:0/3354946501 wait complete. 2024-09-13T11:11:37.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 Processor -- start 2024-09-13T11:11:37.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- start start 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200727e0 0x7fe92013ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe9201d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200b1b20 0x7fe9201d9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe92014e740 con 0x7fe9200b1b20 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe92014e5c0 con 0x7fe920072bc0 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe92014e8c0 con 0x7fe9200727e0 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe9201d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe9201d9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48396/0 (socket says 172.21.15.102:48396) 2024-09-13T11:11:37.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 -- 172.21.15.102:0/1220604801 learned_addr learned my addr 172.21.15.102:0/1220604801 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe925657640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200727e0 0x7fe92013ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe925e58640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200b1b20 0x7fe9201d9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 -- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200727e0 msgr2=0x7fe92013ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200727e0 0x7fe92013ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 -- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200b1b20 msgr2=0x7fe9201d9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200b1b20 0x7fe9201d9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 -- 172.21.15.102:0/1220604801 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92013b1e0 con 0x7fe920072bc0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe924e56640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe9201d9410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e840 tx=0x7fe91000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe910017070 con 0x7fe920072bc0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91000ee90 con 0x7fe920072bc0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe920135020 con 0x7fe920072bc0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91000cb60 con 0x7fe920072bc0 2024-09-13T11:11:37.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe920142af0 con 0x7fe920072bc0 2024-09-13T11:11:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe91001a070 con 0x7fe920072bc0 2024-09-13T11:11:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fe910013470 con 0x7fe920072bc0 2024-09-13T11:11:37.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.670+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe920141870 con 0x7fe920072bc0 2024-09-13T11:11:37.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.682+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe91000cda0 con 0x7fe920072bc0 2024-09-13T11:11:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.754+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a629f7f1-92ab-4d94-ba61-c62fa852306e", "id": 0} v 0) -- 0x7fe9200b2820 con 0x7fe920072bc0 2024-09-13T11:11:37.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe915ffb640 1 -- 172.21.15.102:0/1220604801 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a629f7f1-92ab-4d94-ba61-c62fa852306e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fe9100059a0 con 0x7fe920072bc0 2024-09-13T11:11:37.766 INFO:teuthology.orchestra.run.smithi102.stdout:0 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 msgr2=0x7fe9201d9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe9201d9410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe91000e840 tx=0x7fe91000ec40 comp rx=0 tx=0).stop 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 shutdown_connections 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9200b1b20 0x7fe9201d9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe920072bc0 0x7fe9201d9410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 --2- 172.21.15.102:0/1220604801 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9200727e0 0x7fe92013ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 >> 172.21.15.102:0/1220604801 conn(0x7fe920068890 msgr2=0x7fe920136710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 shutdown_connections 2024-09-13T11:11:37.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.766+0000 7fe9278bb640 1 -- 172.21.15.102:0/1220604801 wait complete. 2024-09-13T11:11:37.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c 1 2024-09-13T11:11:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 Processor -- start 2024-09-13T11:11:37.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 -- start start 2024-09-13T11:11:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f9044144800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9044072cb0 0x7f9044144d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90440748c0 con 0x7f90440728d0 2024-09-13T11:11:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9044073ab0 con 0x7f9044072cb0 2024-09-13T11:11:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.902+0000 7f9049fef640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f9044074ba0 con 0x7f90440b1560 2024-09-13T11:11:37.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9044072cb0 0x7f9044144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9044072cb0 0x7f9044144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48412/0 (socket says 172.21.15.102:48412) 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 -- 172.21.15.102:0/2001136926 learned_addr learned my addr 172.21.15.102:0/2001136926 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9042ffd640 1 --2- 172.21.15.102:0/2001136926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f9044144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 -- 172.21.15.102:0/2001136926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 msgr2=0x7f9044144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 --2- 172.21.15.102:0/2001136926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f9044144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 -- 172.21.15.102:0/2001136926 >> v1:172.21.15.39:6789/0 conn(0x7f90440728d0 legacy=0x7f90440b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 -- 172.21.15.102:0/2001136926 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90440734c0 con 0x7f9044072cb0 2024-09-13T11:11:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9043fff640 1 --2- 172.21.15.102:0/2001136926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9044072cb0 0x7f9044144d40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c01c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d36266c27520713 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f90427fc640 1 -- 172.21.15.102:0/2001136926 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0a5640 con 0x7f9044072cb0 2024-09-13T11:11:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f90427fc640 1 -- 172.21.15.102:0/2001136926 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c0a57e0 con 0x7f9044072cb0 2024-09-13T11:11:37.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f90427fc640 1 -- 172.21.15.102:0/2001136926 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0a5bb0 con 0x7f9044072cb0 2024-09-13T11:11:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 -- 172.21.15.102:0/2001136926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9044072cb0 msgr2=0x7f9044144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 --2- 172.21.15.102:0/2001136926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9044072cb0 0x7f9044144d40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f903c009e50 tx=0x7f903c01c980 comp rx=0 tx=0).stop 2024-09-13T11:11:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 -- 172.21.15.102:0/2001136926 shutdown_connections 2024-09-13T11:11:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 --2- 172.21.15.102:0/2001136926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9044072cb0 0x7f9044144d40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 --2- 172.21.15.102:0/2001136926 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f9044144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 -- 172.21.15.102:0/2001136926 >> 172.21.15.102:0/2001136926 conn(0x7f90440b3fb0 msgr2=0x7f90440b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 -- 172.21.15.102:0/2001136926 shutdown_connections 2024-09-13T11:11:37.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.906+0000 7f9049fef640 1 -- 172.21.15.102:0/2001136926 wait complete. 2024-09-13T11:11:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 Processor -- start 2024-09-13T11:11:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 -- start start 2024-09-13T11:11:37.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 0x7f90441dca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9044072cb0 0x7f904413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f904413e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f904414e740 con 0x7f9044072cb0 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f904414e5c0 con 0x7f90440728d0 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f904414e8c0 con 0x7f90440b1560 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 0x7f90441dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 0x7f90441dca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48420/0 (socket says 172.21.15.102:48420) 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 -- 172.21.15.102:0/318115043 learned_addr learned my addr 172.21.15.102:0/318115043 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9043fff640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f904413e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9042ffd640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9044072cb0 0x7f904413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9043fff640 1 -- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 msgr2=0x7f904413e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T11:11:37.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9043fff640 1 -- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 msgr2=0x7f904413e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9043fff640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f904413e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9043fff640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f904413e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 -- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 msgr2=0x7f904413e810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f904413e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 -- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9044072cb0 msgr2=0x7f904413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9044072cb0 0x7f904413e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 -- 172.21.15.102:0/318115043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9044148350 con 0x7f90440728d0 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f90437fe640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 0x7f90441dca50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f903400c3f0 tx=0x7f903400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034017070 con 0x7f90440728d0 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90340052d0 con 0x7f90440728d0 2024-09-13T11:11:37.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9044145d20 con 0x7f90440728d0 2024-09-13T11:11:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034003820 con 0x7f90440728d0 2024-09-13T11:11:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9044145950 con 0x7f90440728d0 2024-09-13T11:11:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f903401a070 con 0x7f90440728d0 2024-09-13T11:11:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.910+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9034011ba0 con 0x7f90440728d0 2024-09-13T11:11:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.914+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90440b0e50 con 0x7f90440728d0 2024-09-13T11:11:37.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.914+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9034021070 con 0x7f90440728d0 2024-09-13T11:11:37.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:37.986+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c", "id": 1} v 0) -- 0x7f9044145ef0 con 0x7f90440728d0 2024-09-13T11:11:38.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f903bfff640 1 -- 172.21.15.102:0/318115043 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9034011590 con 0x7f90440728d0 2024-09-13T11:11:38.004 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 msgr2=0x7f90441dca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 0x7f90441dca50 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f903400c3f0 tx=0x7f903400c8b0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 shutdown_connections 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f90440b1560 0x7f904413e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9044072cb0 0x7f904413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 --2- 172.21.15.102:0/318115043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90440728d0 0x7f90441dca50 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 >> 172.21.15.102:0/318115043 conn(0x7f90440b3fb0 msgr2=0x7f90440b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 shutdown_connections 2024-09-13T11:11:38.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.002+0000 7f9049fef640 1 -- 172.21.15.102:0/318115043 wait complete. 2024-09-13T11:11:38.022 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 4f366e2c-b85b-48a5-80a9-a705cf7eac3f 2 2024-09-13T11:11:38.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29b9752640 1 Processor -- start 2024-09-13T11:11:38.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29b9752640 1 -- start start 2024-09-13T11:11:38.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29b9752640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f29b4137da0 0x7f29b414cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29b9752640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b40747d0 con 0x7f29b40727e0 2024-09-13T11:11:38.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29b9752640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b4074ab0 con 0x7f29b40b1b20 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29b9752640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f29b413edc0 con 0x7f29b4137da0 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.142+0000 7f29aa7fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f29b40b1b20 0x7f29b4137690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:44366/0 (socket says 172.21.15.102:44366) 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29aa7fc640 1 -- 172.21.15.102:0/2891707348 learned_addr learned my addr 172.21.15.102:0/2891707348 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 --2- 172.21.15.102:0/2891707348 >> v2:172.21.15.39:3300/0 conn(0x7f29b4137da0 0x7f29b414cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570059537 0 0) 0x7f29b4074ab0 con 0x7f29b40b1b20 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a0003530 con 0x7f29b40b1b20 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3284839885 0 0) 0x7f29a0003530 con 0x7f29b40b1b20 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 >> v2:172.21.15.39:3300/0 conn(0x7f29b4137da0 msgr2=0x7f29b414cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 --2- 172.21.15.102:0/2891707348 >> v2:172.21.15.39:3300/0 conn(0x7f29b4137da0 0x7f29b414cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 >> v1:172.21.15.39:6789/0 conn(0x7f29b40727e0 legacy=0x7f29b4141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b4141fa0 con 0x7f29b40b1b20 2024-09-13T11:11:38.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f299c001700 con 0x7f29b40b1b20 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 >> v1:172.21.15.102:6789/0 conn(0x7f29b40b1b20 legacy=0x7f29b4137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29a0003a60 0x7f29a0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a0004810 0x7f29a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29a00052f0 0x7f29a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f29b413edc0 con 0x7f29a0004810 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29a000c1c0 con 0x7f29a00052f0 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f29a000c3c0 con 0x7f29a0003a60 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29a00052f0 0x7f29a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b2ffd640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29a0003a60 0x7f29a0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29aa7fc640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a0004810 0x7f29a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 -- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29a0003a60 msgr2=0x7f29a0003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29a0003a60 0x7f29a0003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 -- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a0004810 msgr2=0x7f29a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a0004810 0x7f29a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 -- 172.21.15.102:0/2891707348 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a0003530 con 0x7f29a00052f0 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 -- 172.21.15.102:0/2891707348 reap_dead start 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b37fe640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29a00052f0 0x7f29a000b9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009ab0 tx=0x7f29ac01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9614b51c7aac553a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0096b0 con 0x7f29a00052f0 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac004020 con 0x7f29a00052f0 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.146+0000 7f29b27fc640 1 -- 172.21.15.102:0/2891707348 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac004410 con 0x7f29a00052f0 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/2891707348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29a00052f0 msgr2=0x7f29a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29a00052f0 0x7f29a000b9d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009ab0 tx=0x7f29ac01ca70 comp rx=0 tx=0).stop 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/2891707348 shutdown_connections 2024-09-13T11:11:38.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 --2- 172.21.15.102:0/2891707348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29a00052f0 0x7f29a000b9d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/2891707348 >> 172.21.15.102:0/2891707348 conn(0x7f29b4068890 msgr2=0x7f29b4068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/2891707348 shutdown_connections 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/2891707348 wait complete. 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 Processor -- start 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- start start 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a00052f0 0x7f29b413c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29b41383f0 0x7f29b4130260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 0x7f29b413c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f29b4137a20 con 0x7f29a00052f0 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29b41378a0 con 0x7f29b41307a0 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f29b4137ba0 con 0x7f29b41383f0 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 0x7f29b413c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 0x7f29b413c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48440/0 (socket says 172.21.15.102:48440) 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 -- 172.21.15.102:0/1288766213 learned_addr learned my addr 172.21.15.102:0/1288766213 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b2ffd640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a00052f0 0x7f29b413c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29aa7fc640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29b41383f0 0x7f29b4130260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 -- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29b41383f0 msgr2=0x7f29b4130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29b41383f0 0x7f29b4130260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 -- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a00052f0 msgr2=0x7f29b413c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a00052f0 0x7f29b413c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 -- 172.21.15.102:0/1288766213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b413b6d0 con 0x7f29b41307a0 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b2ffd640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a00052f0 0x7f29b413c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b37fe640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 0x7f29b413c9d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01c8a0 tx=0x7f29ac019810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0b7070 con 0x7f29b41307a0 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ac003830 con 0x7f29b41307a0 2024-09-13T11:11:38.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b4130c50 con 0x7f29b41307a0 2024-09-13T11:11:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac003be0 con 0x7f29b41307a0 2024-09-13T11:11:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b4131420 con 0x7f29b41307a0 2024-09-13T11:11:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29ac0ba070 con 0x7f29b41307a0 2024-09-13T11:11:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f29ac0a6c80 con 0x7f29b41307a0 2024-09-13T11:11:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.150+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b4141870 con 0x7f29b41307a0 2024-09-13T11:11:38.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.154+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f29ac0c1070 con 0x7f29b41307a0 2024-09-13T11:11:38.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.226+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f366e2c-b85b-48a5-80a9-a705cf7eac3f", "id": 2} v 0) -- 0x7f29b40b5db0 con 0x7f29b41307a0 2024-09-13T11:11:38.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29abfff640 1 -- 172.21.15.102:0/1288766213 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f366e2c-b85b-48a5-80a9-a705cf7eac3f", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f29ac016780 con 0x7f29b41307a0 2024-09-13T11:11:38.242 INFO:teuthology.orchestra.run.smithi102.stdout:2 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 msgr2=0x7f29b413c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 0x7f29b413c9d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f29ac01c8a0 tx=0x7f29ac019810 comp rx=0 tx=0).stop 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 shutdown_connections 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f29b41307a0 0x7f29b413c9d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f29b41383f0 0x7f29b4130260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 --2- 172.21.15.102:0/1288766213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29a00052f0 0x7f29b413c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 >> 172.21.15.102:0/1288766213 conn(0x7f29b4068890 msgr2=0x7f29b40b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 shutdown_connections 2024-09-13T11:11:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.242+0000 7f29b9752640 1 -- 172.21.15.102:0/1288766213 wait complete. 2024-09-13T11:11:38.259 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new b9bae4c0-1450-4201-a1c5-72e3ed8ab82e 3 2024-09-13T11:11:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.374+0000 7f7d032da640 1 Processor -- start 2024-09-13T11:11:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.374+0000 7f7d032da640 1 -- start start 2024-09-13T11:11:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d032da640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc0717f0 0x7f7cfc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d032da640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cfc139cd0 0x7f7cfc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d032da640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cfc074ec0 con 0x7f7cfc074aa0 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d032da640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7cfc1407b0 con 0x7f7cfc139cd0 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d032da640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc073be0 con 0x7f7cfc0717f0 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cfc139cd0 0x7f7cfc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cfc139cd0 0x7f7cfc06c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48442/0 (socket says 172.21.15.102:48442) 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 -- 172.21.15.102:0/4113007349 learned_addr learned my addr 172.21.15.102:0/4113007349 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01076640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc0717f0 0x7f7cfc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 -- 172.21.15.102:0/4113007349 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc0717f0 msgr2=0x7f7cfc071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc0717f0 0x7f7cfc071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 -- 172.21.15.102:0/4113007349 >> v1:172.21.15.102:6789/0 conn(0x7f7cfc074aa0 legacy=0x7f7cfc1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01877640 1 -- 172.21.15.102:0/4113007349 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc073e30 con 0x7f7cfc139cd0 2024-09-13T11:11:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.378+0000 7f7d01076640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc0717f0 0x7f7cfc071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:38.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01877640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc139cd0 0x7f7cfc06c940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009e50 tx=0x7f7cf401f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a990bcf9148cc619 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf3fff640 1 -- 172.21.15.102:0/4113007349 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40b4070 con 0x7f7cfc139cd0 2024-09-13T11:11:38.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf3fff640 1 -- 172.21.15.102:0/4113007349 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf40af400 con 0x7f7cfc139cd0 2024-09-13T11:11:38.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf3fff640 1 -- 172.21.15.102:0/4113007349 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf40af7d0 con 0x7f7cfc139cd0 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/4113007349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc139cd0 msgr2=0x7f7cfc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc139cd0 0x7f7cfc06c940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4009e50 tx=0x7f7cf401f190 comp rx=0 tx=0).stop 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/4113007349 shutdown_connections 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc139cd0 0x7f7cfc06c940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 --2- 172.21.15.102:0/4113007349 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc0717f0 0x7f7cfc071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/4113007349 >> 172.21.15.102:0/4113007349 conn(0x7f7cfc0b6330 msgr2=0x7f7cfc0b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/4113007349 shutdown_connections 2024-09-13T11:11:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/4113007349 wait complete. 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 Processor -- start 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- start start 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 0x7f7cfc143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7cfc074aa0 0x7f7cfc1d6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc139cd0 0x7f7cfc13c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc074250 con 0x7f7cfc074aa0 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc074610 con 0x7f7cfc0717f0 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc13a180 con 0x7f7cfc139cd0 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 0x7f7cfc143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 0x7f7cfc143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48458/0 (socket says 172.21.15.102:48458) 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 -- 172.21.15.102:0/1611943821 learned_addr learned my addr 172.21.15.102:0/1611943821 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 -- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc139cd0 msgr2=0x7f7cfc13c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01877640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc139cd0 0x7f7cfc13c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d00875640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7cfc074aa0 0x7f7cfc1d6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc139cd0 0x7f7cfc13c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 -- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7cfc074aa0 msgr2=0x7f7cfc1d6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7cfc074aa0 0x7f7cfc1d6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 -- 172.21.15.102:0/1611943821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc0aad00 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d01076640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 0x7f7cfc143640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800e810 tx=0x7f7cf800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8017070 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf800c8d0 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc13cda0 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800f040 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc13bb70 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7cf801a070 con 0x7f7cfc0717f0 2024-09-13T11:11:38.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.382+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7cf801cc70 con 0x7f7cfc0717f0 2024-09-13T11:11:38.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.386+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc071bd0 con 0x7f7cfc0717f0 2024-09-13T11:11:38.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.386+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7cf800cca0 con 0x7f7cfc0717f0 2024-09-13T11:11:38.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.458+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b9bae4c0-1450-4201-a1c5-72e3ed8ab82e", "id": 3} v 0) -- 0x7f7cfc069130 con 0x7f7cfc0717f0 2024-09-13T11:11:38.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.466+0000 7f7cf1ffb640 1 -- 172.21.15.102:0/1611943821 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9bae4c0-1450-4201-a1c5-72e3ed8ab82e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7cf801c450 con 0x7f7cfc0717f0 2024-09-13T11:11:38.468 INFO:teuthology.orchestra.run.smithi102.stdout:3 2024-09-13T11:11:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 msgr2=0x7f7cfc143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 0x7f7cfc143640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800e810 tx=0x7f7cf800ecd0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 shutdown_connections 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7cfc139cd0 0x7f7cfc13c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7cfc074aa0 0x7f7cfc1d6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 --2- 172.21.15.102:0/1611943821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc0717f0 0x7f7cfc143640 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 >> 172.21.15.102:0/1611943821 conn(0x7f7cfc0b6330 msgr2=0x7f7cfc0b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 shutdown_connections 2024-09-13T11:11:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.470+0000 7f7d032da640 1 -- 172.21.15.102:0/1611943821 wait complete. 2024-09-13T11:11:38.485 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 9d122931-52a3-4486-973e-c979703307da 4 2024-09-13T11:11:38.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 Processor -- start 2024-09-13T11:11:38.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 -- start start 2024-09-13T11:11:38.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4a80727e0 0x7ff4a8141890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4a8137da0 0x7ff4a814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a80747d0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a8074ab0 con 0x7ff4a8137da0 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4afe9f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a813edc0 con 0x7ff4a80727e0 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4a80727e0 0x7ff4a8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4a80727e0 0x7ff4a8141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48460/0 (socket says 172.21.15.102:48460) 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 -- 172.21.15.102:0/2912528642 learned_addr learned my addr 172.21.15.102:0/2912528642 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4ae43c640 1 --2- 172.21.15.102:0/2912528642 >> v2:172.21.15.39:3300/0 conn(0x7ff4a8137da0 0x7ff4a814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 -- 172.21.15.102:0/2912528642 >> v2:172.21.15.39:3300/0 conn(0x7ff4a8137da0 msgr2=0x7ff4a814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 --2- 172.21.15.102:0/2912528642 >> v2:172.21.15.39:3300/0 conn(0x7ff4a8137da0 0x7ff4a814bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 -- 172.21.15.102:0/2912528642 >> v1:172.21.15.102:6789/0 conn(0x7ff4a80b1b20 legacy=0x7ff4a8137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4adc3b640 1 -- 172.21.15.102:0/2912528642 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a8072bc0 con 0x7ff4a80727e0 2024-09-13T11:11:38.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.602+0000 7ff4ae43c640 1 --2- 172.21.15.102:0/2912528642 >> v2:172.21.15.39:3300/0 conn(0x7ff4a8137da0 0x7ff4a814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:11:38.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4adc3b640 1 --2- 172.21.15.102:0/2912528642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80727e0 0x7ff4a8141890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80b4ce0 tx=0x7ff4a001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=430e3b6caa86fe3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4acc39640 1 -- 172.21.15.102:0/2912528642 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00a5710 con 0x7ff4a80727e0 2024-09-13T11:11:38.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4acc39640 1 -- 172.21.15.102:0/2912528642 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4a00a58b0 con 0x7ff4a80727e0 2024-09-13T11:11:38.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4acc39640 1 -- 172.21.15.102:0/2912528642 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00a5c80 con 0x7ff4a80727e0 2024-09-13T11:11:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 -- 172.21.15.102:0/2912528642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80727e0 msgr2=0x7ff4a8141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/2912528642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80727e0 0x7ff4a8141890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80b4ce0 tx=0x7ff4a001c940 comp rx=0 tx=0).stop 2024-09-13T11:11:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 -- 172.21.15.102:0/2912528642 shutdown_connections 2024-09-13T11:11:38.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/2912528642 >> v2:172.21.15.39:3300/0 conn(0x7ff4a8137da0 0x7ff4a814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/2912528642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80727e0 0x7ff4a8141890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 -- 172.21.15.102:0/2912528642 >> 172.21.15.102:0/2912528642 conn(0x7ff4a8068890 msgr2=0x7ff4a8068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 -- 172.21.15.102:0/2912528642 shutdown_connections 2024-09-13T11:11:38.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 -- 172.21.15.102:0/2912528642 wait complete. 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 Processor -- start 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.606+0000 7ff4afe9f640 1 -- start start 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a80727e0 0x7ff4a813c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 0x7ff4a8134760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff4a8137da0 0x7ff4a8134ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a814ec80 con 0x7ff4a80727e0 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a814eb00 con 0x7ff4a80b1b20 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a814ee00 con 0x7ff4a8137da0 2024-09-13T11:11:38.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 0x7ff4a8134760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 0x7ff4a8134760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48464/0 (socket says 172.21.15.102:48464) 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 -- 172.21.15.102:0/3021596800 learned_addr learned my addr 172.21.15.102:0/3021596800 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4adc3b640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a80727e0 0x7ff4a813c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ae43c640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff4a8137da0 0x7ff4a8134ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 -- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff4a8137da0 msgr2=0x7ff4a8134ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff4a8137da0 0x7ff4a8134ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 -- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a80727e0 msgr2=0x7ff4a813c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a80727e0 0x7ff4a813c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 -- 172.21.15.102:0/3021596800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a813e5b0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4ad43a640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 0x7ff4a8134760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c500 tx=0x7ff49800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498017070 con 0x7ff4a80b1b20 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980052d0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a813d1e0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498012870 con 0x7ff4a80b1b20 2024-09-13T11:11:38.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a813b6d0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff49801a070 con 0x7ff4a80b1b20 2024-09-13T11:11:38.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff498003bf0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.610+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a8141870 con 0x7ff4a80b1b20 2024-09-13T11:11:38.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.614+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff498021020 con 0x7ff4a80b1b20 2024-09-13T11:11:38.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.682+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d122931-52a3-4486-973e-c979703307da", "id": 4} v 0) -- 0x7ff4a80768e0 con 0x7ff4a80b1b20 2024-09-13T11:11:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff49e7fc640 1 -- 172.21.15.102:0/3021596800 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d122931-52a3-4486-973e-c979703307da", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff498003600 con 0x7ff4a80b1b20 2024-09-13T11:11:38.699 INFO:teuthology.orchestra.run.smithi102.stdout:4 2024-09-13T11:11:38.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 msgr2=0x7ff4a8134760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 0x7ff4a8134760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c500 tx=0x7ff49800c9c0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 shutdown_connections 2024-09-13T11:11:38.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7ff4a8137da0 0x7ff4a8134ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a80b1b20 0x7ff4a8134760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 --2- 172.21.15.102:0/3021596800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4a80727e0 0x7ff4a813c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 >> 172.21.15.102:0/3021596800 conn(0x7ff4a8068890 msgr2=0x7ff4a80b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 shutdown_connections 2024-09-13T11:11:38.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.698+0000 7ff4afe9f640 1 -- 172.21.15.102:0/3021596800 wait complete. 2024-09-13T11:11:38.716 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23 5 2024-09-13T11:11:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f601d34e640 1 Processor -- start 2024-09-13T11:11:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f601d34e640 1 -- start start 2024-09-13T11:11:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f601d34e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6018137690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f601d34e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60180747d0 con 0x7f60180727e0 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f601d34e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6018074ab0 con 0x7f6018072bc0 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f601d34e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f601813edc0 con 0x7f60180b1b20 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f60177fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6018072bc0 0x7f601814bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:44404/0 (socket says 172.21.15.102:44404) 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f60177fe640 1 -- 172.21.15.102:0/3795784150 learned_addr learned my addr 172.21.15.102:0/3795784150 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f60167fc640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6018137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.826+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241076383 0 0) 0x7f6018074ab0 con 0x7f6018072bc0 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6000003530 con 0x7f6018072bc0 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4205905512 0 0) 0x7f6000003530 con 0x7f6018072bc0 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 msgr2=0x7f6018137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6018137690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 >> v1:172.21.15.39:6789/0 conn(0x7f60180727e0 legacy=0x7f6018141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6018141fa0 con 0x7f6018072bc0 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f6010001a80 con 0x7f6018072bc0 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6018137690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 >> v1:172.21.15.102:6789/0 conn(0x7f6018072bc0 legacy=0x7f601814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6000003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f6000004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6000004d50 0x7f60000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f601813edc0 con 0x7f6000004d50 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f600000bbc0 con 0x7f6000004050 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f600000bdc0 con 0x7f60180b1b20 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f6000004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6016ffd640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6000003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60177fe640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6000004d50 0x7f60000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 -- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 msgr2=0x7f6000003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f60180b1b20 0x7f6000003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 -- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6000004d50 msgr2=0x7f60000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6000004d50 0x7f60000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 -- 172.21.15.102:0/3795784150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6000003530 con 0x7f6000004050 2024-09-13T11:11:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60167fc640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f6000004810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f600c0098a0 tx=0x7f600c01c570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bfdcc5f76f25078 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c00f040 con 0x7f6000004050 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600c0a9680 con 0x7f6000004050 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f6015ffb640 1 -- 172.21.15.102:0/3795784150 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0a9a50 con 0x7f6000004050 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f601d34e640 1 -- 172.21.15.102:0/3795784150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 msgr2=0x7f6000004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f601d34e640 1 --2- 172.21.15.102:0/3795784150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f6000004810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f600c0098a0 tx=0x7f600c01c570 comp rx=0 tx=0).stop 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f60177fe640 1 -- 172.21.15.102:0/3795784150 reap_dead start 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f601d34e640 1 -- 172.21.15.102:0/3795784150 shutdown_connections 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f601d34e640 1 -- 172.21.15.102:0/3795784150 >> 172.21.15.102:0/3795784150 conn(0x7f6018068890 msgr2=0x7f6018068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f601d34e640 1 -- 172.21.15.102:0/3795784150 shutdown_connections 2024-09-13T11:11:38.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.830+0000 7f601d34e640 1 -- 172.21.15.102:0/3795784150 wait complete. 2024-09-13T11:11:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 Processor -- start 2024-09-13T11:11:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- start start 2024-09-13T11:11:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f601813d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60181315a0 0x7f6018131a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6018144270 0x7f60181446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6018137a20 con 0x7f60181315a0 2024-09-13T11:11:38.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f60181378a0 con 0x7f6000004050 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f6018137ba0 con 0x7f6018144270 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f601813d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f601813d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48480/0 (socket says 172.21.15.102:48480) 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 -- 172.21.15.102:0/2764910413 learned_addr learned my addr 172.21.15.102:0/2764910413 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f60167fc640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60181315a0 0x7f6018131a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f60177fe640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6018144270 0x7f60181446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 -- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6018144270 msgr2=0x7f60181446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6018144270 0x7f60181446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 -- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60181315a0 msgr2=0x7f6018131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60181315a0 0x7f6018131a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 -- 172.21.15.102:0/2764910413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6018143d90 con 0x7f6000004050 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f6016ffd640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f601813d3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f600800e570 tx=0x7f600800ea30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60080052e0 con 0x7f6000004050 2024-09-13T11:11:38.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6008018070 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601813e3c0 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008003820 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60181385d0 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.834+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6018137fd0 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.838+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60080039c0 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.838+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f600801dbe0 con 0x7f6000004050 2024-09-13T11:11:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.838+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f600801d690 con 0x7f6000004050 2024-09-13T11:11:38.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.910+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23", "id": 5} v 0) -- 0x7f60180b5950 con 0x7f6000004050 2024-09-13T11:11:38.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.918+0000 7f5fff7fe640 1 -- 172.21.15.102:0/2764910413 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f6008003cb0 con 0x7f6000004050 2024-09-13T11:11:38.921 INFO:teuthology.orchestra.run.smithi102.stdout:5 2024-09-13T11:11:38.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 msgr2=0x7f601813d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f601813d3c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f600800e570 tx=0x7f600800ea30 comp rx=0 tx=0).stop 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 shutdown_connections 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6018144270 0x7f60181446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60181315a0 0x7f6018131a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 --2- 172.21.15.102:0/2764910413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6000004050 0x7f601813d3c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 >> 172.21.15.102:0/2764910413 conn(0x7f6018068890 msgr2=0x7f60180b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 shutdown_connections 2024-09-13T11:11:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:38.922+0000 7f601d34e640 1 -- 172.21.15.102:0/2764910413 wait complete. 2024-09-13T11:11:38.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 281e59b9-335b-488f-842c-8730faf46fd8 6 2024-09-13T11:11:39.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 Processor -- start 2024-09-13T11:11:39.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 -- start start 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 0x7f41800735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f418006cd20 0x7f418013ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4180074760 con 0x7f418013b220 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4180074cb0 con 0x7f418006cd20 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.054+0000 7f4186f5b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f41800749d0 con 0x7f418006c940 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f41854f8640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f418013b220 0x7f4180141230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:44410/0 (socket says 172.21.15.102:44410) 2024-09-13T11:11:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f41854f8640 1 -- 172.21.15.102:0/2996168829 learned_addr learned my addr 172.21.15.102:0/2996168829 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 --2- 172.21.15.102:0/2996168829 >> v2:172.21.15.39:3300/0 conn(0x7f418006cd20 0x7f418013ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f4184cf7640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 0x7f41800735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691527265 0 0) 0x7f4180074760 con 0x7f418013b220 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4168003530 con 0x7f418013b220 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3590608080 0 0) 0x7f4168003530 con 0x7f418013b220 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 msgr2=0x7f41800735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 0x7f41800735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 >> v2:172.21.15.39:3300/0 conn(0x7f418006cd20 msgr2=0x7f418013ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 --2- 172.21.15.102:0/2996168829 >> v2:172.21.15.39:3300/0 conn(0x7f418006cd20 0x7f418013ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4180141940 con 0x7f418013b220 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f4170001700 con 0x7f418013b220 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 >> v1:172.21.15.102:6789/0 conn(0x7f418013b220 legacy=0x7f4180141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 0x7f4168003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168004030 0x7f4168004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4168004d50 0x7f41680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4180074cb0 con 0x7f4168004d50 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f41800749d0 con 0x7f4168004030 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f416800bb00 con 0x7f418006c940 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168004030 0x7f4168004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f41854f8640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4168004d50 0x7f41680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 -- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 msgr2=0x7f4168003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f418006c940 0x7f4168003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 -- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4168004d50 msgr2=0x7f41680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4168004d50 0x7f41680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.058+0000 7f417ffff640 1 -- 172.21.15.102:0/2996168829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168003530 con 0x7f4168004030 2024-09-13T11:11:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417ffff640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168004030 0x7f4168004810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4180070e80 tx=0x7f417401ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd764e2cce366f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41740b2070 con 0x7f4168004030 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41740a5510 con 0x7f4168004030 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417f7fe640 1 -- 172.21.15.102:0/2996168829 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41740096b0 con 0x7f4168004030 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- 172.21.15.102:0/2996168829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168004030 msgr2=0x7f4168004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 --2- 172.21.15.102:0/2996168829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4168004030 0x7f4168004810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4180070e80 tx=0x7f417401ca30 comp rx=0 tx=0).stop 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f41854f8640 1 -- 172.21.15.102:0/2996168829 reap_dead start 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- 172.21.15.102:0/2996168829 shutdown_connections 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- 172.21.15.102:0/2996168829 >> 172.21.15.102:0/2996168829 conn(0x7f41800b6330 msgr2=0x7f41800b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- 172.21.15.102:0/2996168829 shutdown_connections 2024-09-13T11:11:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- 172.21.15.102:0/2996168829 wait complete. 2024-09-13T11:11:39.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 Processor -- start 2024-09-13T11:11:39.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- start start 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4168004030 0x7f418011e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 0x7f4180072a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41801d85e0 0x7f418013a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4180073980 con 0x7f41801d85e0 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4180073800 con 0x7f41800aef10 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4186f5b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4180141b90 con 0x7f4168004030 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 0x7f4180072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 0x7f4180072a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48502/0 (socket says 172.21.15.102:48502) 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f417ffff640 1 -- 172.21.15.102:0/2399626972 learned_addr learned my addr 172.21.15.102:0/2399626972 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f41854f8640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41801d85e0 0x7f418013a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.062+0000 7f4184cf7640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4168004030 0x7f418011e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417ffff640 1 -- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4168004030 msgr2=0x7f418011e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417ffff640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4168004030 0x7f418011e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417ffff640 1 -- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41801d85e0 msgr2=0x7f418013a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417ffff640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41801d85e0 0x7f418013a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417ffff640 1 -- 172.21.15.102:0/2399626972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418011f6a0 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f41854f8640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41801d85e0 0x7f418013a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417ffff640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 0x7f4180072a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f417401cf10 tx=0x7f4168005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41740ba030 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417400f000 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418011dbb0 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41740b2040 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41801d8a60 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41740bd070 con 0x7f41800aef10 2024-09-13T11:11:39.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f41740bfb40 con 0x7f41800aef10 2024-09-13T11:11:39.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41801d8d50 con 0x7f41800aef10 2024-09-13T11:11:39.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.066+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f41740c7070 con 0x7f41800aef10 2024-09-13T11:11:39.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.138+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "281e59b9-335b-488f-842c-8730faf46fd8", "id": 6} v 0) -- 0x7f418011f450 con 0x7f41800aef10 2024-09-13T11:11:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f417d7fa640 1 -- 172.21.15.102:0/2399626972 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "281e59b9-335b-488f-842c-8730faf46fd8", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f4174016740 con 0x7f41800aef10 2024-09-13T11:11:39.148 INFO:teuthology.orchestra.run.smithi102.stdout:6 2024-09-13T11:11:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 msgr2=0x7f4180072a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 0x7f4180072a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f417401cf10 tx=0x7f4168005840 comp rx=0 tx=0).stop 2024-09-13T11:11:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 shutdown_connections 2024-09-13T11:11:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41801d85e0 0x7f418013a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41800aef10 0x7f4180072a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 --2- 172.21.15.102:0/2399626972 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4168004030 0x7f418011e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 >> 172.21.15.102:0/2399626972 conn(0x7f41800b6330 msgr2=0x7f41800b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 shutdown_connections 2024-09-13T11:11:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.146+0000 7f4186f5b640 1 -- 172.21.15.102:0/2399626972 wait complete. 2024-09-13T11:11:39.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 47e46895-c208-4a00-9c67-fb8285be4d05 7 2024-09-13T11:11:39.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.274+0000 7f8c94126640 1 Processor -- start 2024-09-13T11:11:39.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.274+0000 7f8c94126640 1 -- start start 2024-09-13T11:11:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c94126640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8c8c076080 0x7f8c8c071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c94126640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8c071f90 con 0x7f8c8c0746a0 2024-09-13T11:11:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c94126640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8c076460 con 0x7f8c8c074280 2024-09-13T11:11:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c94126640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8c8c0aff40 con 0x7f8c8c076080 2024-09-13T11:11:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c916c1640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8c8c074280 0x7f8c8c13d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:44416/0 (socket says 172.21.15.102:44416) 2024-09-13T11:11:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c916c1640 1 -- 172.21.15.102:0/1964980633 learned_addr learned my addr 172.21.15.102:0/1964980633 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137307007 0 0) 0x7f8c8c076460 con 0x7f8c8c074280 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/1964980633 >> v2:172.21.15.39:3300/0 conn(0x7f8c8c076080 0x7f8c8c071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c78003530 con 0x7f8c8c074280 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3436645169 0 0) 0x7f8c78003530 con 0x7f8c8c074280 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 >> v2:172.21.15.39:3300/0 conn(0x7f8c8c076080 msgr2=0x7f8c8c071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 --2- 172.21.15.102:0/1964980633 >> v2:172.21.15.39:3300/0 conn(0x7f8c8c076080 0x7f8c8c071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 >> v1:172.21.15.39:6789/0 conn(0x7f8c8c0746a0 legacy=0x7f8c8c14a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c0738a0 con 0x7f8c8c074280 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f8c7c001700 con 0x7f8c8c074280 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 >> v1:172.21.15.102:6789/0 conn(0x7f8c8c074280 legacy=0x7f8c8c13d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c78003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c78004810 0x7f8c78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c780052f0 0x7f8c7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c0aff40 con 0x7f8c78004810 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7800c1c0 con 0x7f8c78003a60 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f8c7800c3c0 con 0x7f8c780052f0 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c78003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c916c1640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c78004810 0x7f8c78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c926c3640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c780052f0 0x7f8c7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 -- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c780052f0 msgr2=0x7f8c7800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c780052f0 0x7f8c7800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 -- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c78004810 msgr2=0x7f8c78004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c78004810 0x7f8c78004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 -- 172.21.15.102:0/1964980633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c78003530 con 0x7f8c78003a60 2024-09-13T11:11:39.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c926c3640 1 -- 172.21.15.102:0/1964980633 reap_dead start 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c78003e80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009330 tx=0x7f8c8801ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c8ec658d0c64644 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c880b4070 con 0x7f8c78003a60 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c880a7bf0 con 0x7f8c78003a60 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.278+0000 7f8c90ec0640 1 -- 172.21.15.102:0/1964980633 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800bbe0 con 0x7f8c78003a60 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/1964980633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 msgr2=0x7f8c78003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c78003e80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c88009330 tx=0x7f8c8801ee00 comp rx=0 tx=0).stop 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/1964980633 shutdown_connections 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 --2- 172.21.15.102:0/1964980633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c78003e80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/1964980633 >> 172.21.15.102:0/1964980633 conn(0x7f8c8c0b2310 msgr2=0x7f8c8c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:39.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/1964980633 shutdown_connections 2024-09-13T11:11:39.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/1964980633 wait complete. 2024-09-13T11:11:39.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 Processor -- start 2024-09-13T11:11:39.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- start start 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c8c0aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c8c13ffc0 0x7f8c8c1dbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c8c1dc400 0x7f8c8c13e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c072970 con 0x7f8c8c13ffc0 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c073c40 con 0x7f8c78003a60 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c072af0 con 0x7f8c8c1dc400 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c8c0aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c8c0aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48524/0 (socket says 172.21.15.102:48524) 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 -- 172.21.15.102:0/2891138089 learned_addr learned my addr 172.21.15.102:0/2891138089 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c916c1640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c8c13ffc0 0x7f8c8c1dbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c926c3640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c8c1dc400 0x7f8c8c13e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 -- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c8c1dc400 msgr2=0x7f8c8c13e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c8c1dc400 0x7f8c8c13e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 -- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c8c13ffc0 msgr2=0x7f8c8c1dbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c8c13ffc0 0x7f8c8c1dbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 -- 172.21.15.102:0/2891138089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c141880 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c91ec2640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c8c0aeb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c88000c10 tx=0x7f8c78005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c880b4070 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c880afa80 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c1dc860 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800bbe0 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c140eb0 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8c88003620 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f8c88008150 con 0x7f8c78003a60 2024-09-13T11:11:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.282+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8c071cb0 con 0x7f8c78003a60 2024-09-13T11:11:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.286+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8c8c141880 con 0x7f8c78003a60 2024-09-13T11:11:39.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.358+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47e46895-c208-4a00-9c67-fb8285be4d05", "id": 7} v 0) -- 0x7f8c8c0b20c0 con 0x7f8c78003a60 2024-09-13T11:11:39.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.362+0000 7f8c827fc640 1 -- 172.21.15.102:0/2891138089 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47e46895-c208-4a00-9c67-fb8285be4d05", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8c88018b10 con 0x7f8c78003a60 2024-09-13T11:11:39.364 INFO:teuthology.orchestra.run.smithi102.stdout:7 2024-09-13T11:11:39.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.362+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 msgr2=0x7f8c8c0aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c8c0aeb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8c88000c10 tx=0x7f8c78005840 comp rx=0 tx=0).stop 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 shutdown_connections 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f8c8c1dc400 0x7f8c8c13e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8c8c13ffc0 0x7f8c8c1dbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 --2- 172.21.15.102:0/2891138089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c78003a60 0x7f8c8c0aeb60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 >> 172.21.15.102:0/2891138089 conn(0x7f8c8c0b2310 msgr2=0x7f8c8c13acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 shutdown_connections 2024-09-13T11:11:39.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-13T11:11:39.366+0000 7f8c94126640 1 -- 172.21.15.102:0/2891138089 wait complete. 2024-09-13T11:11:39.381 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T11:11:39.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T11:11:39.383 INFO:tasks.ceph.osd.0:Started 2024-09-13T11:11:39.383 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T11:11:39.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T11:11:39.386 INFO:tasks.ceph.osd.1:Started 2024-09-13T11:11:39.386 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T11:11:39.386 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T11:11:39.388 INFO:tasks.ceph.osd.2:Started 2024-09-13T11:11:39.389 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T11:11:39.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T11:11:39.392 INFO:tasks.ceph.osd.3:Started 2024-09-13T11:11:39.392 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T11:11:39.392 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T11:11:39.394 INFO:tasks.ceph.osd.4:Started 2024-09-13T11:11:39.394 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T11:11:39.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T11:11:39.396 INFO:tasks.ceph.osd.5:Started 2024-09-13T11:11:39.397 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T11:11:39.397 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T11:11:39.399 INFO:tasks.ceph.osd.6:Started 2024-09-13T11:11:39.399 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T11:11:39.399 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T11:11:39.401 INFO:tasks.ceph.osd.7:Started 2024-09-13T11:11:39.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T11:11:39.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 Processor -- start 2024-09-13T11:11:39.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 -- start start 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1b84072890 0x7f1b840b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b84072c70 0x7f1b84141a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b84074880 con 0x7f1b84141f50 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1b840730c0 con 0x7f1b84072c70 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b89642640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1b84074b60 con 0x7f1b84072890 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b84072c70 0x7f1b84141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b84072c70 0x7f1b84141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33288/0 (socket says 172.21.15.39:33288) 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 -- 172.21.15.39:0/1955233199 learned_addr learned my addr 172.21.15.39:0/1955233199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b82ffd640 1 --2- 172.21.15.39:0/1955233199 >> v2:172.21.15.102:3300/0 conn(0x7f1b84072890 0x7f1b840b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 -- 172.21.15.39:0/1955233199 >> v2:172.21.15.102:3300/0 conn(0x7f1b84072890 msgr2=0x7f1b840b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 --2- 172.21.15.39:0/1955233199 >> v2:172.21.15.102:3300/0 conn(0x7f1b84072890 0x7f1b840b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.535 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 -- 172.21.15.39:0/1955233199 >> v1:172.21.15.102:6789/0 conn(0x7f1b84141f50 legacy=0x7f1b840b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:39.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b827fc640 1 -- 172.21.15.39:0/1955233199 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84141210 con 0x7f1b84072c70 2024-09-13T11:11:39.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.532+0000 7f1b82ffd640 1 --2- 172.21.15.39:0/1955233199 >> v2:172.21.15.102:3300/0 conn(0x7f1b84072890 0x7f1b840b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:39.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b827fc640 1 --2- 172.21.15.39:0/1955233199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84141a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1b840b4c00 tx=0x7f1b7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b309384678791cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:39.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b81ffb640 1 -- 172.21.15.39:0/1955233199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780b1070 con 0x7f1b84072c70 2024-09-13T11:11:39.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b81ffb640 1 -- 172.21.15.39:0/1955233199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b780a8050 con 0x7f1b84072c70 2024-09-13T11:11:39.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b81ffb640 1 -- 172.21.15.39:0/1955233199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780ac860 con 0x7f1b84072c70 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 -- 172.21.15.39:0/1955233199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 msgr2=0x7f1b84141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 --2- 172.21.15.39:0/1955233199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84141a10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1b840b4c00 tx=0x7f1b7801c4d0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 -- 172.21.15.39:0/1955233199 shutdown_connections 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 --2- 172.21.15.39:0/1955233199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84141a10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 --2- 172.21.15.39:0/1955233199 >> v2:172.21.15.102:3300/0 conn(0x7f1b84072890 0x7f1b840b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 -- 172.21.15.39:0/1955233199 >> 172.21.15.39:0/1955233199 conn(0x7f1b84068890 msgr2=0x7f1b84068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 -- 172.21.15.39:0/1955233199 shutdown_connections 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 -- 172.21.15.39:0/1955233199 wait complete. 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 Processor -- start 2024-09-13T11:11:39.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.536+0000 7f1b89642640 1 -- start start 2024-09-13T11:11:39.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b84072890 0x7f1b8414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84137160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b840aa970 0x7f1b841376a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8414e6d0 con 0x7f1b84072c70 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8414e550 con 0x7f1b840aa970 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8414e850 con 0x7f1b84072890 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b82ffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b84072890 0x7f1b8414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84137160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b82ffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b84072890 0x7f1b8414a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53250/0 (socket says 172.21.15.39:53250) 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b82ffd640 1 -- 172.21.15.39:0/3738269315 learned_addr learned my addr 172.21.15.39:0/3738269315 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b837fe640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b840aa970 0x7f1b841376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:39.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 -- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b84072890 msgr2=0x7f1b8414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b84072890 0x7f1b8414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 -- 172.21.15.39:0/3738269315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b840aa970 msgr2=0x7f1b841376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b840aa970 0x7f1b841376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 -- 172.21.15.39:0/3738269315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b840abed0 con 0x7f1b84072c70 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b827fc640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84137160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b780ac000 tx=0x7f1b78019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780b1040 con 0x7f1b84072c70 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b780b5440 con 0x7f1b84072c70 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b840ac210 con 0x7f1b84072c70 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780b5810 con 0x7f1b84072c70 2024-09-13T11:11:39.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841d6d70 con 0x7f1b84072c70 2024-09-13T11:11:39.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b780bc020 con 0x7f1b84072c70 2024-09-13T11:11:39.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1b780b5d40 con 0x7f1b84072c70 2024-09-13T11:11:39.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.540+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b840b1ab0 con 0x7f1b84072c70 2024-09-13T11:11:39.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.544+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b780c3020 con 0x7f1b84072c70 2024-09-13T11:11:39.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.604+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b840768e0 con 0x7f1b84072c70 2024-09-13T11:11:39.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.604+0000 7f1b6b7fe640 1 -- 172.21.15.39:0/3738269315 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1b840ac210 con 0x7f1b84072c70 2024-09-13T11:11:39.606 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:11:39.607 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:11:39.360650+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:11:39.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 msgr2=0x7f1b84137160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84137160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b780ac000 tx=0x7f1b78019270 comp rx=0 tx=0).stop 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 shutdown_connections 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b840aa970 0x7f1b841376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84072c70 0x7f1b84137160 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 --2- 172.21.15.39:0/3738269315 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1b84072890 0x7f1b8414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 >> 172.21.15.39:0/3738269315 conn(0x7f1b84068890 msgr2=0x7f1b840b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 shutdown_connections 2024-09-13T11:11:39.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:39.608+0000 7f1b89642640 1 -- 172.21.15.39:0/3738269315 wait complete. 2024-09-13T11:11:39.624 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T11:11:39.625 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T11:11:40.002 INFO:tasks.ceph.mgr.x.smithi102.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T11:11:40.003 INFO:tasks.ceph.mgr.x.smithi102.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T11:11:40.003 INFO:tasks.ceph.mgr.x.smithi102.stderr: from numpy import show_config as show_numpy_config 2024-09-13T11:11:40.289 INFO:tasks.ceph.mgr.y.smithi039.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T11:11:40.289 INFO:tasks.ceph.mgr.y.smithi039.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T11:11:40.289 INFO:tasks.ceph.mgr.y.smithi039.stderr: from numpy import show_config as show_numpy_config 2024-09-13T11:11:40.332 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-13T11:11:40.332+0000 7fdfa243d7c0 -1 Falling back to public interface 2024-09-13T11:11:40.432 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T11:11:40.548 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 Processor -- start 2024-09-13T11:11:40.548 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 -- start start 2024-09-13T11:11:40.549 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efd8c072010 0x7efd8c142be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 0x7efd8c143120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c0732d0 con 0x7efd8c071730 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c071b10 con 0x7efd8c072010 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd939b4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c13d1a0 con 0x7efd8c0749d0 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 0x7efd8c143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 0x7efd8c143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:52728/0 (socket says 172.21.15.39:52728) 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 -- 172.21.15.39:0/4108796647 learned_addr learned my addr 172.21.15.39:0/4108796647 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd90f4f640 1 --2- 172.21.15.39:0/4108796647 >> v2:172.21.15.102:3300/0 conn(0x7efd8c072010 0x7efd8c142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 -- 172.21.15.39:0/4108796647 >> v2:172.21.15.102:3300/0 conn(0x7efd8c072010 msgr2=0x7efd8c142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 --2- 172.21.15.39:0/4108796647 >> v2:172.21.15.102:3300/0 conn(0x7efd8c072010 0x7efd8c142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 -- 172.21.15.39:0/4108796647 >> v1:172.21.15.102:6789/0 conn(0x7efd8c071730 legacy=0x7efd8c13c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:40.550 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd91f51640 1 -- 172.21.15.39:0/4108796647 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c070f80 con 0x7efd8c0749d0 2024-09-13T11:11:40.551 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.548+0000 7efd90f4f640 1 --2- 172.21.15.39:0/4108796647 >> v2:172.21.15.102:3300/0 conn(0x7efd8c072010 0x7efd8c142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:40.552 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd91f51640 1 --2- 172.21.15.39:0/4108796647 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 0x7efd8c143120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efd8400d150 tx=0x7efd8401eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f49edcae032ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:40.553 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd83fff640 1 -- 172.21.15.39:0/4108796647 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840ad070 con 0x7efd8c0749d0 2024-09-13T11:11:40.553 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd83fff640 1 -- 172.21.15.39:0/4108796647 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840a79d0 con 0x7efd8c0749d0 2024-09-13T11:11:40.553 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd83fff640 1 -- 172.21.15.39:0/4108796647 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840a7da0 con 0x7efd8c0749d0 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 -- 172.21.15.39:0/4108796647 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 msgr2=0x7efd8c143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 --2- 172.21.15.39:0/4108796647 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 0x7efd8c143120 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efd8400d150 tx=0x7efd8401eb80 comp rx=0 tx=0).stop 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 -- 172.21.15.39:0/4108796647 shutdown_connections 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 --2- 172.21.15.39:0/4108796647 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c0749d0 0x7efd8c143120 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 --2- 172.21.15.39:0/4108796647 >> v2:172.21.15.102:3300/0 conn(0x7efd8c072010 0x7efd8c142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 -- 172.21.15.39:0/4108796647 >> 172.21.15.39:0/4108796647 conn(0x7efd8c0b5180 msgr2=0x7efd8c0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 -- 172.21.15.39:0/4108796647 shutdown_connections 2024-09-13T11:11:40.554 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 -- 172.21.15.39:0/4108796647 wait complete. 2024-09-13T11:11:40.555 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 Processor -- start 2024-09-13T11:11:40.555 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.552+0000 7efd939b4640 1 -- start start 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c071730 0x7efd8c1dae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 0x7efd8c1db350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd8c0749d0 0x7efd8c144b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c14cb20 con 0x7efd8c0749d0 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c14c9a0 con 0x7efd8c071730 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c14cca0 con 0x7efd8c072010 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd90f4f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 0x7efd8c1db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:40.558 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd90f4f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 0x7efd8c1db350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:52734/0 (socket says 172.21.15.39:52734) 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd90f4f640 1 -- 172.21.15.39:0/2674614929 learned_addr learned my addr 172.21.15.39:0/2674614929 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd8c0749d0 0x7efd8c144b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91750640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c071730 0x7efd8c1dae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 -- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 msgr2=0x7efd8c1db350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 0x7efd8c1db350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 -- 172.21.15.39:0/2674614929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c071730 msgr2=0x7efd8c1dae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c071730 0x7efd8c1dae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 -- 172.21.15.39:0/2674614929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c1db9a0 con 0x7efd8c0749d0 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91750640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c071730 0x7efd8c1dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd90f4f640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 0x7efd8c1db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:40.559 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd91f51640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd8c0749d0 0x7efd8c144b80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd840af000 tx=0x7efd8401b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840c0030 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840a77f0 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c143d30 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840ad040 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c145290 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd840c3070 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7efd840c5ae0 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.556+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c146b30 con 0x7efd8c0749d0 2024-09-13T11:11:40.560 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.560+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efd8c146b30 con 0x7efd8c0749d0 2024-09-13T11:11:40.620 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd8c13c6b0 con 0x7efd8c0749d0 2024-09-13T11:11:40.621 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd81ffb640 1 -- 172.21.15.39:0/2674614929 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7efd84018800 con 0x7efd8c0749d0 2024-09-13T11:11:40.621 INFO:teuthology.misc.health.smithi039.stdout: 2024-09-13T11:11:40.621 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":10,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:11:39.360650+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:11:40.622 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd8c0749d0 msgr2=0x7efd8c144b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:40.622 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd8c0749d0 0x7efd8c144b80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd840af000 tx=0x7efd8401b920 comp rx=0 tx=0).stop 2024-09-13T11:11:40.622 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 shutdown_connections 2024-09-13T11:11:40.622 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efd8c0749d0 0x7efd8c144b80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.622 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efd8c072010 0x7efd8c1db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.622 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 --2- 172.21.15.39:0/2674614929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c071730 0x7efd8c1dae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:40.623 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 >> 172.21.15.39:0/2674614929 conn(0x7efd8c0b5180 msgr2=0x7efd8c0b5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:40.623 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 shutdown_connections 2024-09-13T11:11:40.623 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:40.620+0000 7efd939b4640 1 -- 172.21.15.39:0/2674614929 wait complete. 2024-09-13T11:11:40.638 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T11:11:40.770 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-13T11:11:40.770+0000 7f71196927c0 -1 Falling back to public interface 2024-09-13T11:11:40.798 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-13T11:11:40.798+0000 7f0970f2b7c0 -1 Falling back to public interface 2024-09-13T11:11:40.801 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-13T11:11:40.800+0000 7fcc05a827c0 -1 Falling back to public interface 2024-09-13T11:11:40.824 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-13T11:11:40.824+0000 7f4ec3b607c0 -1 Falling back to public interface 2024-09-13T11:11:41.078 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-13T11:11:41.078+0000 7fb3963de7c0 -1 Falling back to public interface 2024-09-13T11:11:41.297 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-13T11:11:41.296+0000 7fe6fb5007c0 -1 Falling back to public interface 2024-09-13T11:11:41.319 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-13T11:11:41.318+0000 7f93159607c0 -1 Falling back to public interface 2024-09-13T11:11:43.000 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T11:11:42.998+0000 7fb38aa18640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T11:11:43.000 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-13T11:11:42.998+0000 7fb38aa18640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T11:11:44.451 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-13T11:11:44.448+0000 7fdfa243d7c0 -1 osd.3 0 log_to_monitors true 2024-09-13T11:11:44.872 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-13T11:11:44.872+0000 7fcc05a827c0 -1 osd.0 0 log_to_monitors true 2024-09-13T11:11:44.877 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-13T11:11:44.874+0000 7f0970f2b7c0 -1 osd.6 0 log_to_monitors true 2024-09-13T11:11:45.314 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-13T11:11:45.314+0000 7f71196927c0 -1 osd.7 0 log_to_monitors true 2024-09-13T11:11:45.397 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-13T11:11:45.396+0000 7fe6fb5007c0 -1 osd.2 0 log_to_monitors true 2024-09-13T11:11:45.428 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-13T11:11:45.426+0000 7fb3963de7c0 -1 osd.4 0 log_to_monitors true 2024-09-13T11:11:45.470 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-13T11:11:45.468+0000 7f4ec3b607c0 -1 osd.1 0 log_to_monitors true 2024-09-13T11:11:45.542 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-13T11:11:45.542+0000 7f93159607c0 -1 osd.5 0 log_to_monitors true 2024-09-13T11:11:46.077 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-13T11:11:46.076+0000 7fcc01a2b640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T11:11:46.097 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-09-13T11:11:46.096+0000 7fcbfd865640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:46.703 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-13T11:11:46.700+0000 7fdf9ebf8640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T11:11:46.724 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-09-13T11:11:46.724+0000 7fdf96218640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:46.915 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-13T11:11:46.914+0000 7f096d6e6640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T11:11:46.938 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-13T11:11:46.938+0000 7f0964d06640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:47.069 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-13T11:11:47.070+0000 7fb392387640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T11:11:47.070 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-13T11:11:47.070+0000 7f711563b640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T11:11:47.071 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-13T11:11:47.070+0000 7f9311909640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T11:11:47.075 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-13T11:11:47.076+0000 7f4ebfb09640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T11:11:47.096 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-09-13T11:11:47.096+0000 7f4ebb943640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:47.099 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-13T11:11:47.098+0000 7f930d743640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:47.099 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-13T11:11:47.098+0000 7fb38e1c1640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:47.099 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-13T11:11:47.098+0000 7f7111475640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:47.443 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T11:11:47.595 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59cae3e640 1 Processor -- start 2024-09-13T11:11:47.596 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59cae3e640 1 -- start start 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59cae3e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f59c406f2d0 0x7f59c40af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59cae3e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c406e4e0 con 0x7f59c40afc90 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59cae3e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c40b1e20 con 0x7f59c406e100 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59cae3e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f59c40aea90 con 0x7f59c406f2d0 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c93db640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f59c40afc90 0x7f59c40b0120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:34802/0 (socket says 172.21.15.39:34802) 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c93db640 1 -- 172.21.15.39:0/3481803077 learned_addr learned my addr 172.21.15.39:0/3481803077 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c3fff640 1 --2- 172.21.15.39:0/3481803077 >> v2:172.21.15.102:3300/0 conn(0x7f59c406f2d0 0x7f59c40af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106876584 0 0) 0x7f59c406e4e0 con 0x7f59c40afc90 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b4003530 con 0x7f59c40afc90 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3382660472 0 0) 0x7f59b4003530 con 0x7f59c40afc90 2024-09-13T11:11:47.598 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 >> v2:172.21.15.102:3300/0 conn(0x7f59c406f2d0 msgr2=0x7f59c40af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 --2- 172.21.15.39:0/3481803077 >> v2:172.21.15.102:3300/0 conn(0x7f59c406f2d0 0x7f59c40af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 >> v1:172.21.15.102:6789/0 conn(0x7f59c406e100 legacy=0x7f59c40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c40aed70 con 0x7f59c40afc90 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f59bc001a80 con 0x7f59c40afc90 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 >> v1:172.21.15.39:6789/0 conn(0x7f59c40afc90 legacy=0x7f59c40b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59b4003ab0 0x7f59b4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4004810 0x7f59b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b40052f0 0x7f59b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40aea90 con 0x7f59b4003ab0 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59b400c1f0 con 0x7f59b40052f0 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f59b400c3f0 con 0x7f59b4004810 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59b4003ab0 0x7f59b4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.599 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c93db640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b40052f0 0x7f59b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c3fff640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4004810 0x7f59b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c8bda640 1 -- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4004810 msgr2=0x7f59b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4004810 0x7f59b4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c8bda640 1 -- 172.21.15.39:0/3481803077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b40052f0 msgr2=0x7f59b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b40052f0 0x7f59b400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.596+0000 7f59c8bda640 1 -- 172.21.15.39:0/3481803077 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b4003530 con 0x7f59b4003ab0 2024-09-13T11:11:47.600 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59c93db640 1 -- 172.21.15.39:0/3481803077 reap_dead start 2024-09-13T11:11:47.601 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59b4003ab0 0x7f59b4003ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001790 tx=0x7f59b801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea428e1845f71d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:47.601 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80013e0 con 0x7f59b4003ab0 2024-09-13T11:11:47.601 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b80052d0 con 0x7f59b4003ab0 2024-09-13T11:11:47.601 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59c37fe640 1 -- 172.21.15.39:0/3481803077 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8003840 con 0x7f59b4003ab0 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 -- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59b4003ab0 msgr2=0x7f59b4003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59b4003ab0 0x7f59b4003ed0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f59b8001790 tx=0x7f59b801c3d0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 -- 172.21.15.39:0/3481803077 shutdown_connections 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3481803077 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59b4003ab0 0x7f59b4003ed0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 -- 172.21.15.39:0/3481803077 >> 172.21.15.39:0/3481803077 conn(0x7f59c40b6ee0 msgr2=0x7f59c40b72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 -- 172.21.15.39:0/3481803077 shutdown_connections 2024-09-13T11:11:47.602 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.600+0000 7f59cae3e640 1 -- 172.21.15.39:0/3481803077 wait complete. 2024-09-13T11:11:47.603 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 Processor -- start 2024-09-13T11:11:47.603 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- start start 2024-09-13T11:11:47.605 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 0x7f59c4146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.605 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c4149660 0x7f59c4147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.605 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59c414a330 0x7f59c413f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.605 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40af8d0 con 0x7f59c414a330 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40af750 con 0x7f59c4149660 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f59c40afa50 con 0x7f59b4003ab0 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 0x7f59c4146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 0x7f59c4146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:52808/0 (socket says 172.21.15.39:52808) 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 -- 172.21.15.39:0/3852202987 learned_addr learned my addr 172.21.15.39:0/3852202987 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c93db640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59c414a330 0x7f59c413f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 -- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c4149660 msgr2=0x7f59c4147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c3fff640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c4149660 0x7f59c4147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c4149660 0x7f59c4147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 -- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59c414a330 msgr2=0x7f59c413f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59c414a330 0x7f59c413f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 -- 172.21.15.39:0/3852202987 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c414bd30 con 0x7f59b4003ab0 2024-09-13T11:11:47.606 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c93db640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59c414a330 0x7f59c413f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:47.607 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c8bda640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 0x7f59c4146550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59b801aad0 tx=0x7f59b4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:47.607 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80b8070 con 0x7f59b4003ab0 2024-09-13T11:11:47.607 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b80013c0 con 0x7f59b4003ab0 2024-09-13T11:11:47.607 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c4140410 con 0x7f59b4003ab0 2024-09-13T11:11:47.607 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8005480 con 0x7f59b4003ab0 2024-09-13T11:11:47.607 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c414a980 con 0x7f59b4003ab0 2024-09-13T11:11:47.608 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c414a120 con 0x7f59b4003ab0 2024-09-13T11:11:47.608 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.604+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 4) ==== 95954+0+0 (secure 0 0 0) 0x7f59b80bb070 con 0x7f59b4003ab0 2024-09-13T11:11:47.608 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.608+0000 7f59c17fa640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f59a8072070 0x7f59a8074530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:47.608 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.608+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 3071+0+0 (secure 0 0 0) 0x7f59b812bd90 con 0x7f59b4003ab0 2024-09-13T11:11:47.608 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.608+0000 7f59c3fff640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f59a8072070 0x7f59a8074530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:47.608 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.608+0000 7f59c3fff640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f59a8072070 0x7f59a8074530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59c41df670 tx=0x7f59b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:47.614 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.612+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f59b812f030 con 0x7f59b4003ab0 2024-09-13T11:11:47.843 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-13T11:11:47.840+0000 7fe6f74a9640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T11:11:47.868 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-09-13T11:11:47.868+0000 7fe6ef2db640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T11:11:47.891 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59c414bb30 con 0x7f59b4003ab0 2024-09-13T11:11:47.892 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59c17fa640 1 -- 172.21.15.39:0/3852202987 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8515 (secure 0 0 0) 0x7f59b8016130 con 0x7f59b4003ab0 2024-09-13T11:11:47.892 INFO:teuthology.misc.health.smithi039.stdout: 2024-09-13T11:11:47.893 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":13,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:11:47.055826+0000","last_up_change":"2024-09-13T11:11:47.055826+0000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6809","nonce":1555151115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6811","nonce":1555151115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6815","nonce":1555151115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6813","nonce":1555151115}]},"public_addr":"172.21.15.39:6809/1555151115","cluster_addr":"172.21.15.39:6811/1555151115","heartbeat_back_addr":"172.21.15.39:6815/1555151115","heartbeat_front_addr":"172.21.15.39:6813/1555151115","state":["exists","up"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6801","nonce":2999541781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6803","nonce":2999541781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6807","nonce":2999541781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6805","nonce":2999541781}]},"public_addr":"172.21.15.39:6801/2999541781","cluster_addr":"172.21.15.39:6803/2999541781","heartbeat_back_addr":"172.21.15.39:6807/2999541781","heartbeat_front_addr":"172.21.15.39:6805/2999541781","state":["exists","up"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6809","nonce":2547475669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6811","nonce":2547475669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6815","nonce":2547475669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6813","nonce":2547475669}]},"public_addr":"172.21.15.102:6809/2547475669","cluster_addr":"172.21.15.102:6811/2547475669","heartbeat_back_addr":"172.21.15.102:6815/2547475669","heartbeat_front_addr":"172.21.15.102:6813/2547475669","state":["exists","up"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f59a8072070 msgr2=0x7f59a8074530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f59a8072070 0x7f59a8074530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59c41df670 tx=0x7f59b0008040 comp rx=0 tx=0).stop 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 msgr2=0x7f59c4146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 0x7f59c4146550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f59b801aad0 tx=0x7f59b4005840 comp rx=0 tx=0).stop 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 shutdown_connections 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f59a8072070 0x7f59a8074530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.895 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f59c414a330 0x7f59c413f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.896 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c4149660 0x7f59c4147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.896 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 --2- 172.21.15.39:0/3852202987 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f59b4003ab0 0x7f59c4146550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:47.896 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 >> 172.21.15.39:0/3852202987 conn(0x7f59c40b6ee0 msgr2=0x7f59c4073390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:47.896 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 shutdown_connections 2024-09-13T11:11:47.896 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:47.892+0000 7f59cae3e640 1 -- 172.21.15.39:0/3852202987 wait complete. 2024-09-13T11:11:47.911 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-09-13T11:11:54.719 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T11:11:54.844 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 Processor -- start 2024-09-13T11:11:54.844 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 -- start start 2024-09-13T11:11:54.845 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9020072260 0x7f9020072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:54.845 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f9020144f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:54.845 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9020073660 con 0x7f902013e470 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9020073410 con 0x7f9020072260 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f902611a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f90201454b0 con 0x7f902013e8b0 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901f7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9020072260 0x7f9020072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f9020144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f9020144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:47914/0 (socket says 172.21.15.39:47914) 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901f7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9020072260 0x7f9020072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59714/0 (socket says 172.21.15.39:59714) 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 -- 172.21.15.39:0/2414932945 learned_addr learned my addr 172.21.15.39:0/2414932945 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 -- 172.21.15.39:0/2414932945 >> v2:172.21.15.39:3300/0 conn(0x7f9020072260 msgr2=0x7f9020072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 --2- 172.21.15.39:0/2414932945 >> v2:172.21.15.39:3300/0 conn(0x7f9020072260 0x7f9020072640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 -- 172.21.15.39:0/2414932945 >> v1:172.21.15.102:6789/0 conn(0x7f902013e470 legacy=0x7f9020144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:54.846 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.843+0000 7f901ffff640 1 -- 172.21.15.39:0/2414932945 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90200b1450 con 0x7f902013e8b0 2024-09-13T11:11:54.847 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901ffff640 1 --2- 172.21.15.39:0/2414932945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f9020144f70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e50 tx=0x7f901801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ced25d41706bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:54.848 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901e7fc640 1 -- 172.21.15.39:0/2414932945 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90180a56e0 con 0x7f902013e8b0 2024-09-13T11:11:54.848 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901e7fc640 1 -- 172.21.15.39:0/2414932945 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90180a5880 con 0x7f902013e8b0 2024-09-13T11:11:54.848 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901e7fc640 1 -- 172.21.15.39:0/2414932945 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90180a5c50 con 0x7f902013e8b0 2024-09-13T11:11:54.848 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- 172.21.15.39:0/2414932945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 msgr2=0x7f9020144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 --2- 172.21.15.39:0/2414932945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f9020144f70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e50 tx=0x7f901801ca10 comp rx=0 tx=0).stop 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- 172.21.15.39:0/2414932945 shutdown_connections 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 --2- 172.21.15.39:0/2414932945 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f9020144f70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 --2- 172.21.15.39:0/2414932945 >> v2:172.21.15.39:3300/0 conn(0x7f9020072260 0x7f9020072640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- 172.21.15.39:0/2414932945 >> 172.21.15.39:0/2414932945 conn(0x7f90200b4be0 msgr2=0x7f90200b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- 172.21.15.39:0/2414932945 shutdown_connections 2024-09-13T11:11:54.849 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- 172.21.15.39:0/2414932945 wait complete. 2024-09-13T11:11:54.850 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 Processor -- start 2024-09-13T11:11:54.850 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- start start 2024-09-13T11:11:54.852 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 0x7f90200aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:54.852 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f902013e470 0x7f902013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:54.852 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f902013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:54.852 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f902014e530 con 0x7f9020072260 2024-09-13T11:11:54.852 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f902014e3b0 con 0x7f902013e470 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f902611a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f902014e6b0 con 0x7f902013e8b0 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 0x7f90200aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901ffff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f902013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 0x7f90200aaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59726/0 (socket says 172.21.15.39:59726) 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.847+0000 7f901f7fe640 1 -- 172.21.15.39:0/3119206102 learned_addr learned my addr 172.21.15.39:0/3119206102 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901effd640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f902013e470 0x7f902013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901f7fe640 1 -- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 msgr2=0x7f902013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901f7fe640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f902013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901f7fe640 1 -- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f902013e470 msgr2=0x7f902013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901f7fe640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f902013e470 0x7f902013f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901f7fe640 1 -- 172.21.15.39:0/3119206102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90200ac460 con 0x7f9020072260 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901effd640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f902013e470 0x7f902013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:11:54.853 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901f7fe640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 0x7f90200aaa00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f900800e930 tx=0x7f900800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:54.854 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008017070 con 0x7f9020072260 2024-09-13T11:11:54.854 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900800ca00 con 0x7f9020072260 2024-09-13T11:11:54.854 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90200ac740 con 0x7f9020072260 2024-09-13T11:11:54.854 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900800cdb0 con 0x7f9020072260 2024-09-13T11:11:54.854 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90200aaf40 con 0x7f9020072260 2024-09-13T11:11:54.854 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9020072640 con 0x7f9020072260 2024-09-13T11:11:54.855 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f900801a070 con 0x7f9020072260 2024-09-13T11:11:54.855 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f9017fff640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9000072100 0x7f90000745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:54.855 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f9008092930 con 0x7f9020072260 2024-09-13T11:11:54.856 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901effd640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9000072100 0x7f90000745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:54.856 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.851+0000 7f901effd640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9000072100 0x7f90000745c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f90201dd890 tx=0x7f9010009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:54.858 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:54.855+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f900805e0d0 con 0x7f9020072260 2024-09-13T11:11:55.032 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.031+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f902013cbe0 con 0x7f9020072260 2024-09-13T11:11:55.033 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.031+0000 7f9017fff640 1 -- 172.21.15.39:0/3119206102 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12908 (secure 0 0 0) 0x7f9008062890 con 0x7f9020072260 2024-09-13T11:11:55.034 INFO:teuthology.misc.health.smithi039.stdout: 2024-09-13T11:11:55.034 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":16,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:11:50.084013+0000","last_up_change":"2024-09-13T11:11:48.073845+0000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T11:11:48.029865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6809","nonce":1555151115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6811","nonce":1555151115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6815","nonce":1555151115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6813","nonce":1555151115}]},"public_addr":"172.21.15.39:6809/1555151115","cluster_addr":"172.21.15.39:6811/1555151115","heartbeat_back_addr":"172.21.15.39:6815/1555151115","heartbeat_front_addr":"172.21.15.39:6813/1555151115","state":["exists","up"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6817","nonce":3509723286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6819","nonce":3509723286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6823","nonce":3509723286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6821","nonce":3509723286}]},"public_addr":"172.21.15.39:6817/3509723286","cluster_addr":"172.21.15.39:6819/3509723286","heartbeat_back_addr":"172.21.15.39:6823/3509723286","heartbeat_front_addr":"172.21.15.39:6821/3509723286","state":["exists","up"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6825","nonce":1540683038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6827","nonce":1540683038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6831","nonce":1540683038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6829","nonce":1540683038}]},"public_addr":"172.21.15.39:6825/1540683038","cluster_addr":"172.21.15.39:6827/1540683038","heartbeat_back_addr":"172.21.15.39:6831/1540683038","heartbeat_front_addr":"172.21.15.39:6829/1540683038","state":["exists","up"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6801","nonce":2999541781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6803","nonce":2999541781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6807","nonce":2999541781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6805","nonce":2999541781}]},"public_addr":"172.21.15.39:6801/2999541781","cluster_addr":"172.21.15.39:6803/2999541781","heartbeat_back_addr":"172.21.15.39:6807/2999541781","heartbeat_front_addr":"172.21.15.39:6805/2999541781","state":["exists","up"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6817","nonce":3161248300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6819","nonce":3161248300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6823","nonce":3161248300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6821","nonce":3161248300}]},"public_addr":"172.21.15.102:6817/3161248300","cluster_addr":"172.21.15.102:6819/3161248300","heartbeat_back_addr":"172.21.15.102:6823/3161248300","heartbeat_front_addr":"172.21.15.102:6821/3161248300","state":["exists","up"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6825","nonce":498174754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6827","nonce":498174754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6831","nonce":498174754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6829","nonce":498174754}]},"public_addr":"172.21.15.102:6825/498174754","cluster_addr":"172.21.15.102:6827/498174754","heartbeat_back_addr":"172.21.15.102:6831/498174754","heartbeat_front_addr":"172.21.15.102:6829/498174754","state":["exists","up"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6809","nonce":2547475669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6811","nonce":2547475669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6815","nonce":2547475669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6813","nonce":2547475669}]},"public_addr":"172.21.15.102:6809/2547475669","cluster_addr":"172.21.15.102:6811/2547475669","heartbeat_back_addr":"172.21.15.102:6815/2547475669","heartbeat_front_addr":"172.21.15.102:6813/2547475669","state":["exists","up"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6801","nonce":3217028379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6803","nonce":3217028379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6807","nonce":3217028379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6805","nonce":3217028379}]},"public_addr":"172.21.15.102:6801/3217028379","cluster_addr":"172.21.15.102:6803/3217028379","heartbeat_back_addr":"172.21.15.102:6807/3217028379","heartbeat_front_addr":"172.21.15.102:6805/3217028379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.901346+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.448139+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441429+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.486773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.499628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.879979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.320145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:11:55.036 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9000072100 msgr2=0x7f90000745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:55.036 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9000072100 0x7f90000745c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f90201dd890 tx=0x7f9010009040 comp rx=0 tx=0).stop 2024-09-13T11:11:55.036 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 msgr2=0x7f90200aaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:55.036 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 0x7f90200aaa00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f900800e930 tx=0x7f900800edf0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 shutdown_connections 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9000072100 0x7f90000745c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f902013e8b0 0x7f902013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f902013e470 0x7f902013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 --2- 172.21.15.39:0/3119206102 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9020072260 0x7f90200aaa00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 >> 172.21.15.39:0/3119206102 conn(0x7f90200b4be0 msgr2=0x7f902013d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 shutdown_connections 2024-09-13T11:11:55.037 INFO:teuthology.misc.health.smithi039.stderr:2024-09-13T11:11:55.035+0000 7f902611a640 1 -- 172.21.15.39:0/3119206102 wait complete. 2024-09-13T11:11:55.053 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T11:11:55.053 INFO:tasks.ceph:Creating RBD pool 2024-09-13T11:11:55.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T11:11:55.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 Processor -- start 2024-09-13T11:11:55.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 -- start start 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe988141910 0x7fe98813dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 0x7fe98814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe988074aa0 con 0x7fe988072480 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe988072d40 con 0x7fe988141910 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98eb6a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe988072860 con 0x7fe98813e530 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 0x7fe98814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 0x7fe98814bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:47928/0 (socket says 172.21.15.39:47928) 2024-09-13T11:11:55.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 -- 172.21.15.39:0/4177022519 learned_addr learned my addr 172.21.15.39:0/4177022519 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:55.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe987fff640 1 --2- 172.21.15.39:0/4177022519 >> v2:172.21.15.102:3300/0 conn(0x7fe988141910 0x7fe98813dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:55.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 -- 172.21.15.39:0/4177022519 >> v2:172.21.15.102:3300/0 conn(0x7fe988141910 msgr2=0x7fe98813dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:55.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 --2- 172.21.15.39:0/4177022519 >> v2:172.21.15.102:3300/0 conn(0x7fe988141910 0x7fe98813dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 -- 172.21.15.39:0/4177022519 >> v1:172.21.15.102:6789/0 conn(0x7fe988072480 legacy=0x7fe988141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:55.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.171+0000 7fe98d107640 1 -- 172.21.15.39:0/4177022519 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9880af3d0 con 0x7fe98813e530 2024-09-13T11:11:55.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98d107640 1 --2- 172.21.15.39:0/4177022519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 0x7fe98814bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe980009e50 tx=0x7fe98001d3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f308a4e0ace255d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:55.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe9877fe640 1 -- 172.21.15.39:0/4177022519 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800a5780 con 0x7fe98813e530 2024-09-13T11:11:55.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe9877fe640 1 -- 172.21.15.39:0/4177022519 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9800a5920 con 0x7fe98813e530 2024-09-13T11:11:55.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe9877fe640 1 -- 172.21.15.39:0/4177022519 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800a5cf0 con 0x7fe98813e530 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4177022519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 msgr2=0x7fe98814bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4177022519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 0x7fe98814bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe980009e50 tx=0x7fe98001d3e0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4177022519 shutdown_connections 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4177022519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe98813e530 0x7fe98814bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4177022519 >> v2:172.21.15.102:3300/0 conn(0x7fe988141910 0x7fe98813dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4177022519 >> 172.21.15.39:0/4177022519 conn(0x7fe9880b52b0 msgr2=0x7fe9880b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4177022519 shutdown_connections 2024-09-13T11:11:55.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4177022519 wait complete. 2024-09-13T11:11:55.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 Processor -- start 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- start start 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 0x7fe9880ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe98813e530 0x7fe988149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe988141910 0x7fe988070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe98813eb00 con 0x7fe98813e530 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe98813e980 con 0x7fe988141910 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98eb6a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe98814e870 con 0x7fe988072480 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe987fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe98813e530 0x7fe988149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98c906640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 0x7fe9880ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98c906640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 0x7fe9880ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:47944/0 (socket says 172.21.15.39:47944) 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98c906640 1 -- 172.21.15.39:0/4285662358 learned_addr learned my addr 172.21.15.39:0/4285662358 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:55.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.175+0000 7fe98d107640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe988141910 0x7fe988070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe987fff640 1 -- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 msgr2=0x7fe9880ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe987fff640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 0x7fe9880ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe987fff640 1 -- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe988141910 msgr2=0x7fe988070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe987fff640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe988141910 0x7fe988070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe987fff640 1 -- 172.21.15.39:0/4285662358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe988071510 con 0x7fe98813e530 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98c906640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 0x7fe9880ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98d107640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe988141910 0x7fe988070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe987fff640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe98813e530 0x7fe988149ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00d5d0 tx=0x7fe97c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0125f0 con 0x7fe98813e530 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97c019070 con 0x7fe98813e530 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98814a430 con 0x7fe98813e530 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97c0129b0 con 0x7fe98813e530 2024-09-13T11:11:55.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9880706a0 con 0x7fe98813e530 2024-09-13T11:11:55.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe98813dff0 con 0x7fe98813e530 2024-09-13T11:11:55.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fe97c012b50 con 0x7fe98813e530 2024-09-13T11:11:55.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe9857fa640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe974072100 0x7fe9740745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:55.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe97c0928b0 con 0x7fe98813e530 2024-09-13T11:11:55.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98c906640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe974072100 0x7fe9740745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:55.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.179+0000 7fe98c906640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe974072100 0x7fe9740745c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe978004470 tx=0x7fe978003700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:55.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.183+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe97c05e560 con 0x7fe98813e530 2024-09-13T11:11:55.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:55.359+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fe98813f7b0 con 0x7fe98813e530 2024-09-13T11:11:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.111+0000 7fe9857fa640 1 -- 172.21.15.39:0/4285662358 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (secure 0 0 0) 0x7fe97c05de60 con 0x7fe98813e530 2024-09-13T11:11:56.113 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'rbd' created 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe974072100 msgr2=0x7fe9740745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe974072100 0x7fe9740745c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe978004470 tx=0x7fe978003700 comp rx=0 tx=0).stop 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe98813e530 msgr2=0x7fe988149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe98813e530 0x7fe988149ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe97c00d5d0 tx=0x7fe97c00da90 comp rx=0 tx=0).stop 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 shutdown_connections 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe974072100 0x7fe9740745c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe988141910 0x7fe988070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe98813e530 0x7fe988149ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 --2- 172.21.15.39:0/4285662358 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe988072480 0x7fe9880ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 >> 172.21.15.39:0/4285662358 conn(0x7fe9880b52b0 msgr2=0x7fe9880b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:56.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 shutdown_connections 2024-09-13T11:11:56.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.115+0000 7fe98eb6a640 1 -- 172.21.15.39:0/4285662358 wait complete. 2024-09-13T11:11:56.144 DEBUG:teuthology.orchestra.run.smithi039:> rbd --cluster ceph pool init rbd 2024-09-13T11:11:56.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.271+0000 7faeeec45100 1 Processor -- start 2024-09-13T11:11:56.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.271+0000 7faeeec45100 1 -- start start 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.271+0000 7faeeec45100 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b25220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.271+0000 7faeeec45100 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x564ef18c0c50 con 0x564ef1a84200 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.271+0000 7faeeec45100 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x564ef1a7db20 con 0x564ef1a56230 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.271+0000 7faeeec45100 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x564ef1940a50 con 0x564ef1a84640 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeecf4d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x564ef1a84200 0x564ef1b21af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54066/0 (socket says 172.21.15.39:54066) 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeecf4d640 1 -- 172.21.15.39:0/475766521 learned_addr learned my addr 172.21.15.39:0/475766521 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:11:56.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeee9b0640 1 --2- 172.21.15.39:0/475766521 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b25220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeee9b0640 1 -- 172.21.15.39:0/475766521 >> v1:172.21.15.102:6789/0 conn(0x564ef1a56230 legacy=0x564ef1a7bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeee9b0640 1 -- 172.21.15.39:0/475766521 >> v1:172.21.15.39:6789/0 conn(0x564ef1a84200 legacy=0x564ef1b21af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faedffff640 1 -- 172.21.15.39:0/475766521 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808441175 0 0) 0x564ef18c0c50 con 0x564ef1a84200 2024-09-13T11:11:56.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeee9b0640 1 -- 172.21.15.39:0/475766521 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef1a7dd90 con 0x564ef1a84640 2024-09-13T11:11:56.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.275+0000 7faeee9b0640 1 --2- 172.21.15.39:0/475766521 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b25220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faee800a4d0 tx=0x7faee801b4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42d6b3d53043e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:56.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faedffff640 1 -- 172.21.15.39:0/475766521 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80af070 con 0x564ef1a84640 2024-09-13T11:11:56.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faedffff640 1 -- 172.21.15.39:0/475766521 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee80aa600 con 0x564ef1a84640 2024-09-13T11:11:56.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faedffff640 1 -- 172.21.15.39:0/475766521 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80aa9b0 con 0x564ef1a84640 2024-09-13T11:11:56.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- 172.21.15.39:0/475766521 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 msgr2=0x564ef1b25220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 --2- 172.21.15.39:0/475766521 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b25220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faee800a4d0 tx=0x7faee801b4b0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- 172.21.15.39:0/475766521 shutdown_connections 2024-09-13T11:11:56.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 --2- 172.21.15.39:0/475766521 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b25220 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- 172.21.15.39:0/475766521 >> 172.21.15.39:0/475766521 conn(0x564ef1a876d0 msgr2=0x564ef1a87ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- 172.21.15.39:0/475766521 shutdown_connections 2024-09-13T11:11:56.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- 172.21.15.39:0/475766521 wait complete. 2024-09-13T11:11:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 Processor -- start 2024-09-13T11:11:56.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- start start 2024-09-13T11:11:56.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef1a56230 0x564ef1b194f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:56.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564ef1a84200 0x564ef1b15590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:56.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b15ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:56.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x564ef1944a00 con 0x564ef1a84200 2024-09-13T11:11:56.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564ef19514c0 con 0x564ef1a56230 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.279+0000 7faeeec45100 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x564ef18e7a40 con 0x564ef1a84640 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b15ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeecf4d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564ef1a84200 0x564ef1b15590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b15ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:47956/0 (socket says 172.21.15.39:47956) 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 -- 172.21.15.39:0/3461289305 learned_addr learned my addr 172.21.15.39:0/3461289305 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeed74e640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef1a56230 0x564ef1b194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 -- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef1a56230 msgr2=0x564ef1b194f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef1a56230 0x564ef1b194f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 -- 172.21.15.39:0/3461289305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564ef1a84200 msgr2=0x564ef1b15590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x564ef1a84200 0x564ef1b15590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef1b18da0 con 0x564ef1a84640 2024-09-13T11:11:56.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeee9b0640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b15ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faee800a4d0 tx=0x7faee8018250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80b7070 con 0x564ef1a84640 2024-09-13T11:11:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee80b3410 con 0x564ef1a84640 2024-09-13T11:11:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef1a58c00 con 0x564ef1a84640 2024-09-13T11:11:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee80af040 con 0x564ef1a84640 2024-09-13T11:11:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x564ef1b16070 con 0x564ef1a84640 2024-09-13T11:11:56.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7faee80ba070 con 0x564ef1a84640 2024-09-13T11:11:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faedd7fa640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7faed00709f0 0x7faed0072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 5199+0+0 (secure 0 0 0) 0x7faee812bb70 con 0x564ef1a84640 2024-09-13T11:11:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x564ef1b2b450 con 0x564ef1a84640 2024-09-13T11:11:56.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.283+0000 7faeed74e640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7faed00709f0 0x7faed0072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:56.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:56.287+0000 7faeed74e640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7faed00709f0 0x7faed0072eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faee0000f70 tx=0x7faee0003680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:57.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.131+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (secure 0 0 0) 0x564ef1b16070 con 0x564ef1a84640 2024-09-13T11:11:57.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.131+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faee80aa600 con 0x564ef1a84640 2024-09-13T11:11:57.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.135+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7faee80c1030 con 0x564ef1a84640 2024-09-13T11:11:57.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.135+0000 7faedf7fe640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=18}) -- 0x7faec8002af0 con 0x564ef1a84640 2024-09-13T11:11:57.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.135+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 8 ==== osd_map(18..18 src has 1..18) ==== 666+0+0 (secure 0 0 0) 0x7faee812a3b0 con 0x564ef1a84640 2024-09-13T11:11:57.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.139+0000 7faeeec45100 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x564ef1b2ecb0 0x564ef1b2f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:57.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.139+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x564ef1b37b00 con 0x564ef1b2ecb0 2024-09-13T11:11:57.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.139+0000 7faeecf4d640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x564ef1b2ecb0 0x564ef1b2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:57.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.139+0000 7faeecf4d640 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x564ef1b2ecb0 0x564ef1b2f090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:57.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.147+0000 7faeecf4d640 1 -- 172.21.15.39:0/3461289305 <== osd.5 v2:172.21.15.102:6824/498174754 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7faee400e620 con 0x564ef1b2ecb0 2024-09-13T11:11:57.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.155+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x564ef1b8a090 con 0x564ef1b2ecb0 2024-09-13T11:11:57.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.155+0000 7faeecf4d640 1 -- 172.21.15.39:0/3461289305 <== osd.5 v2:172.21.15.102:6824/498174754 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faee400e620 con 0x564ef1b2ecb0 2024-09-13T11:11:57.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.155+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x564ef1b89080 con 0x564ef1b2ecb0 2024-09-13T11:11:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.155+0000 7faeecf4d640 1 -- 172.21.15.39:0/3461289305 <== osd.5 v2:172.21.15.102:6824/498174754 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faee400e620 con 0x564ef1b2ecb0 2024-09-13T11:11:57.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:57.155+0000 7faedeffd640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7faecc001f10 con 0x564ef1a84640 2024-09-13T11:11:58.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:58.167+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (secure 0 0 0) 0x7faee8015130 con 0x564ef1a84640 2024-09-13T11:11:58.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:58.167+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=19}) -- 0x7faed0077120 con 0x564ef1a84640 2024-09-13T11:11:58.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:58.167+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 10 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (secure 0 0 0) 0x7faee80ffe50 con 0x564ef1a84640 2024-09-13T11:11:58.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:58.167+0000 7faedf7fe640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7faec80057b0 con 0x564ef1b2ecb0 2024-09-13T11:11:58.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:58.179+0000 7faeecf4d640 1 -- 172.21.15.39:0/3461289305 <== osd.5 v2:172.21.15.102:6824/498174754 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7faee400e620 con 0x564ef1b2ecb0 2024-09-13T11:11:58.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:58.179+0000 7faedeffd640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7faecc003360 con 0x564ef1a84640 2024-09-13T11:11:59.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.167+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (secure 0 0 0) 0x7faee80f7100 con 0x564ef1a84640 2024-09-13T11:11:59.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.167+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=20}) -- 0x7faed00772f0 con 0x564ef1a84640 2024-09-13T11:11:59.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.167+0000 7faedd7fa640 1 -- 172.21.15.39:0/3461289305 <== mon.2 v2:172.21.15.39:3301/0 12 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (secure 0 0 0) 0x7faee8100050 con 0x564ef1a84640 2024-09-13T11:11:59.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.167+0000 7faedf7fe640 1 -- 172.21.15.39:0/3461289305 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7faec8005b50 con 0x564ef1b2ecb0 2024-09-13T11:11:59.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeecf4d640 1 -- 172.21.15.39:0/3461289305 <== osd.5 v2:172.21.15.102:6824/498174754 5 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee400e620 con 0x564ef1b2ecb0 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x564ef1b2ecb0 msgr2=0x564ef1b2f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x564ef1b2ecb0 0x564ef1b2f090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7faed00709f0 msgr2=0x7faed0072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7faed00709f0 0x7faed0072eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faee0000f70 tx=0x7faee0003680 comp rx=0 tx=0).stop 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 msgr2=0x564ef1b15ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 --2- 172.21.15.39:0/3461289305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x564ef1a84640 0x564ef1b15ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faee800a4d0 tx=0x7faee8018250 comp rx=0 tx=0).stop 2024-09-13T11:11:59.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeee9b0640 1 -- 172.21.15.39:0/3461289305 reap_dead start 2024-09-13T11:11:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 shutdown_connections 2024-09-13T11:11:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 >> 172.21.15.39:0/3461289305 conn(0x564ef1a876d0 msgr2=0x564ef1a87ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 shutdown_connections 2024-09-13T11:11:59.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.175+0000 7faeeec45100 1 -- 172.21.15.39:0/3461289305 wait complete. 2024-09-13T11:11:59.192 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T11:11:59.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-13T11:11:59.193 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T11:11:59.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 Processor -- start 2024-09-13T11:11:59.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 -- start start 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b40aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa1b40b2f50 0x7fa1b40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b40ab5c0 con 0x7fa1b4146910 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b40b6950 con 0x7fa1b40b2f50 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b9702640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b40ab130 con 0x7fa1b40b6570 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b27fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa1b40b2f50 0x7fa1b40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b37fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa1b4146910 0x7fa1b4146dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54076/0 (socket says 172.21.15.39:54076) 2024-09-13T11:11:59.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b37fe640 1 -- 172.21.15.39:0/208153120 learned_addr learned my addr 172.21.15.39:0/208153120 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:11:59.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b2ffd640 1 --2- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b40aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b27fc640 1 -- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 msgr2=0x7fa1b40aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:59.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b27fc640 1 --2- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b40aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b27fc640 1 -- 172.21.15.39:0/208153120 >> v1:172.21.15.39:6789/0 conn(0x7fa1b4146910 legacy=0x7fa1b4146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b27fc640 1 -- 172.21.15.39:0/208153120 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40aa6f0 con 0x7fa1b40b2f50 2024-09-13T11:11:59.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.327+0000 7fa1b1ffb640 1 -- 172.21.15.39:0/208153120 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837273825 0 0) 0x7fa1b40ab5c0 con 0x7fa1b4146910 2024-09-13T11:11:59.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b27fc640 1 --2- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b40b3350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ab2b0 tx=0x7fa1a401c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa133de0023c3e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:59.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b1ffb640 1 -- 172.21.15.39:0/208153120 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40b0070 con 0x7fa1b40b2f50 2024-09-13T11:11:59.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b1ffb640 1 -- 172.21.15.39:0/208153120 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a40ab600 con 0x7fa1b40b2f50 2024-09-13T11:11:59.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b1ffb640 1 -- 172.21.15.39:0/208153120 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40ab9d0 con 0x7fa1b40b2f50 2024-09-13T11:11:59.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 msgr2=0x7fa1b40b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 --2- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b40b3350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40ab2b0 tx=0x7fa1a401c300 comp rx=0 tx=0).stop 2024-09-13T11:11:59.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- 172.21.15.39:0/208153120 shutdown_connections 2024-09-13T11:11:59.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 --2- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b40b3350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 --2- 172.21.15.39:0/208153120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b40aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- 172.21.15.39:0/208153120 >> 172.21.15.39:0/208153120 conn(0x7fa1b40b9680 msgr2=0x7fa1b40b9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:59.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- 172.21.15.39:0/208153120 shutdown_connections 2024-09-13T11:11:59.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- 172.21.15.39:0/208153120 wait complete. 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 Processor -- start 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- start start 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b413fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1b4146910 0x7fa1b41402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b4150850 con 0x7fa1b40b2f50 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b41506d0 con 0x7fa1b4146910 2024-09-13T11:11:59.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b9702640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b41509d0 con 0x7fa1b40b6570 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b27fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b413fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b2ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b27fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b413fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:47974/0 (socket says 172.21.15.39:47974) 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.331+0000 7fa1b27fc640 1 -- 172.21.15.39:0/3704467070 learned_addr learned my addr 172.21.15.39:0/3704467070 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b27fc640 1 -- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1b4146910 msgr2=0x7fa1b41402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b27fc640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1b4146910 0x7fa1b41402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b27fc640 1 -- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 msgr2=0x7fa1b413c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b27fc640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b413c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b27fc640 1 -- 172.21.15.39:0/3704467070 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b4148440 con 0x7fa1b40b6570 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b2ffd640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b27fc640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b413fd70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4018f70 tx=0x7fa1a4019100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:59.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40b0040 con 0x7fa1b40b6570 2024-09-13T11:11:59.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a40b9070 con 0x7fa1b40b6570 2024-09-13T11:11:59.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a40b4650 con 0x7fa1b40b6570 2024-09-13T11:11:59.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b4147a60 con 0x7fa1b40b6570 2024-09-13T11:11:59.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b413f220 con 0x7fa1b40b6570 2024-09-13T11:11:59.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b40b3350 con 0x7fa1b40b6570 2024-09-13T11:11:59.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fa1a40b47f0 con 0x7fa1b40b6570 2024-09-13T11:11:59.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1ab7fe640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa194072100 0x7fa1940745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fa1a412c560 con 0x7fa1b40b6570 2024-09-13T11:11:59.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b2ffd640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa194072100 0x7fa1940745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.335+0000 7fa1b2ffd640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa194072100 0x7fa1940745c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e740 tx=0x7fa19c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:59.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.339+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa1a4016070 con 0x7fa1b40b6570 2024-09-13T11:11:59.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.511+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa1b40b8c00 con 0x7fa1b40b6570 2024-09-13T11:11:59.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.511+0000 7fa1ab7fe640 1 -- 172.21.15.39:0/3704467070 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v4) ==== 86+0+159 (secure 0 0 0) 0x7fa1a40f80f0 con 0x7fa1b40b6570 2024-09-13T11:11:59.515 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:11:59.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa194072100 msgr2=0x7fa1940745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa194072100 0x7fa1940745c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e740 tx=0x7fa19c00b040 comp rx=0 tx=0).stop 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 msgr2=0x7fa1b413fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b413fd70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4018f70 tx=0x7fa1a4019100 comp rx=0 tx=0).stop 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 shutdown_connections 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa194072100 0x7fa1940745c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1b4146910 0x7fa1b41402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa1b40b6570 0x7fa1b413fd70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 --2- 172.21.15.39:0/3704467070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa1b40b2f50 0x7fa1b413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 >> 172.21.15.39:0/3704467070 conn(0x7fa1b40b9680 msgr2=0x7fa1b4068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 shutdown_connections 2024-09-13T11:11:59.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.515+0000 7fa1b9702640 1 -- 172.21.15.39:0/3704467070 wait complete. 2024-09-13T11:11:59.534 INFO:teuthology.orchestra.run.smithi039.stdout:[{"version":4,"timestamp":"2024-09-13T11:11:47.844789+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"7908.787678"}]}] 2024-09-13T11:11:59.534 INFO:tasks.ceph_manager:config epoch is 4 2024-09-13T11:11:59.535 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T11:11:59.535 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T11:11:59.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T11:11:59.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 Processor -- start 2024-09-13T11:11:59.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 -- start start 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb8071120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4bb81407a0 0x7f4bb8140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bb8073f50 0x7f4bb80743e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb80b0120 con 0x7f4bb8073f50 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb8071aa0 con 0x7f4bb81407a0 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbf4eb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb8136ff0 con 0x7f4bb80afd40 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbd287640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bb8073f50 0x7f4bb80743e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bb8073f50 0x7f4bb80743e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52942/0 (socket says 172.21.15.39:52942) 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 -- 172.21.15.39:0/646945528 learned_addr learned my addr 172.21.15.39:0/646945528 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbd287640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb8071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53096/0 (socket says 172.21.15.39:53096) 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbca86640 1 --2- 172.21.15.39:0/646945528 >> v2:172.21.15.102:3300/0 conn(0x7f4bb81407a0 0x7f4bb8140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 -- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 msgr2=0x7f4bb8071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb8071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 -- 172.21.15.39:0/646945528 >> v2:172.21.15.102:3300/0 conn(0x7f4bb81407a0 msgr2=0x7f4bb8140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 --2- 172.21.15.39:0/646945528 >> v2:172.21.15.102:3300/0 conn(0x7f4bb81407a0 0x7f4bb8140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 -- 172.21.15.39:0/646945528 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8073930 con 0x7f4bb8073f50 2024-09-13T11:11:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbd287640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb8071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:59.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.659+0000 7f4bbda88640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb80743e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4bb806eb30 tx=0x7f4bb001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15d8e9245034309 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:59.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4baffff640 1 -- 172.21.15.39:0/646945528 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00a5650 con 0x7f4bb8073f50 2024-09-13T11:11:59.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4baffff640 1 -- 172.21.15.39:0/646945528 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb00a57f0 con 0x7f4bb8073f50 2024-09-13T11:11:59.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4baffff640 1 -- 172.21.15.39:0/646945528 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb00a5bc0 con 0x7f4bb8073f50 2024-09-13T11:11:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 msgr2=0x7f4bb80743e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb80743e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4bb806eb30 tx=0x7f4bb001c9d0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/646945528 shutdown_connections 2024-09-13T11:11:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb80743e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/646945528 >> v2:172.21.15.102:3300/0 conn(0x7f4bb81407a0 0x7f4bb8140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/646945528 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb8071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/646945528 >> 172.21.15.39:0/646945528 conn(0x7f4bb80b52b0 msgr2=0x7f4bb80b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/646945528 shutdown_connections 2024-09-13T11:11:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/646945528 wait complete. 2024-09-13T11:11:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 Processor -- start 2024-09-13T11:11:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- start start 2024-09-13T11:11:59.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb813bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb813c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb81407a0 0x7f4bb81da830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb81440a0 con 0x7f4bb8073f50 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb8074b30 con 0x7f4bb81407a0 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbf4eb640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb8144220 con 0x7f4bb80afd40 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbd287640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb813bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbca86640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb813c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbd287640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb813bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52956/0 (socket says 172.21.15.39:52956) 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbd287640 1 -- 172.21.15.39:0/1178112494 learned_addr learned my addr 172.21.15.39:0/1178112494 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbda88640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb81407a0 0x7f4bb81da830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbca86640 1 -- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb81407a0 msgr2=0x7f4bb81da830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbca86640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb81407a0 0x7f4bb81da830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbca86640 1 -- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 msgr2=0x7f4bb813bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbca86640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb813bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbca86640 1 -- 172.21.15.39:0/1178112494 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb80aac90 con 0x7f4bb80afd40 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.663+0000 7f4bbd287640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb813bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4bbca86640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb813c8d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800c540 tx=0x7f4ba800ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8004230 con 0x7f4bb80afd40 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba80043d0 con 0x7f4bb80afd40 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb80aaf00 con 0x7f4bb80afd40 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8003860 con 0x7f4bb80afd40 2024-09-13T11:11:59.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb8138f70 con 0x7f4bb80afd40 2024-09-13T11:11:59.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb8139290 con 0x7f4bb80afd40 2024-09-13T11:11:59.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f4ba8039b00 con 0x7f4bb80afd40 2024-09-13T11:11:59.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4badffb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:11:59.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f4ba8092780 con 0x7f4bb80afd40 2024-09-13T11:11:59.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.667+0000 7f4bbd287640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:11:59.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.671+0000 7f4bbd287640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40116e0 tx=0x7f4bb400b3a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:11:59.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.675+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4ba8015020 con 0x7f4bb80afd40 2024-09-13T11:11:59.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.887+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4bb8071120 con 0x7f4bb80afd40 2024-09-13T11:11:59.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.895+0000 7f4badffb640 1 -- 172.21.15.39:0/1178112494 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+184362 (secure 0 0 0) 0x7f4ba805dda0 con 0x7f4bb80afd40 2024-09-13T11:11:59.898 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:11:59.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 msgr2=0x7f4b9c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4bb40116e0 tx=0x7f4bb400b3a0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 msgr2=0x7f4bb813c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb813c8d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ba800c540 tx=0x7f4ba800ca00 comp rx=0 tx=0).stop 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 shutdown_connections 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb81407a0 0x7f4bb81da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb80afd40 0x7f4bb813c8d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 --2- 172.21.15.39:0/1178112494 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb8073f50 0x7f4bb813bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 >> 172.21.15.39:0/1178112494 conn(0x7f4bb80b52b0 msgr2=0x7f4bb8141730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 shutdown_connections 2024-09-13T11:11:59.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:11:59.899+0000 7f4bbf4eb640 1 -- 172.21.15.39:0/1178112494 wait complete. 2024-09-13T11:11:59.917 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":259014220},{"type":"v1","addr":"172.21.15.102:6833","nonce":259014220}]},"active_addr":"172.21.15.102:6833/259014220","active_change":"2024-09-13T11:11:41.960766+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1105641491}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2173544577}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3680783120}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":311333106}]}]} 2024-09-13T11:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T11:11:59.921 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T11:11:59.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T11:12:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 Processor -- start 2024-09-13T11:12:00.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 -- start start 2024-09-13T11:12:00.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5798068920 0x7f5798141150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5798070f40 0x7f5798073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f57980aeef0 0x7f57980af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5798068d00 con 0x7f57980aeef0 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f57980afda0 con 0x7f5798070f40 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f57a0628640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f57980aa530 con 0x7f5798068920 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f57980aeef0 0x7f57980af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579e3c4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5798068920 0x7f5798141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f57980aeef0 0x7f57980af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52968/0 (socket says 172.21.15.39:52968) 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 -- 172.21.15.39:0/1526455295 learned_addr learned my addr 172.21.15.39:0/1526455295 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579dbc3640 1 --2- 172.21.15.39:0/1526455295 >> v2:172.21.15.102:3300/0 conn(0x7f5798070f40 0x7f5798073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 -- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5798068920 msgr2=0x7f5798141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 --2- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5798068920 0x7f5798141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 -- 172.21.15.39:0/1526455295 >> v2:172.21.15.102:3300/0 conn(0x7f5798070f40 msgr2=0x7f5798073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 --2- 172.21.15.39:0/1526455295 >> v2:172.21.15.102:3300/0 conn(0x7f5798070f40 0x7f5798073a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 -- 172.21.15.39:0/1526455295 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579813ec90 con 0x7f57980aeef0 2024-09-13T11:12:00.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579ebc5640 1 --2- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57980aeef0 0x7f57980af380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57980b6750 tx=0x7f579001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21069435e9fc272 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579d3c2640 1 -- 172.21.15.39:0/1526455295 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57900a56d0 con 0x7f57980aeef0 2024-09-13T11:12:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579d3c2640 1 -- 172.21.15.39:0/1526455295 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57900a5870 con 0x7f57980aeef0 2024-09-13T11:12:00.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.043+0000 7f579d3c2640 1 -- 172.21.15.39:0/1526455295 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57900a5c40 con 0x7f57980aeef0 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57980aeef0 msgr2=0x7f57980af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57980aeef0 0x7f57980af380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f57980b6750 tx=0x7f579001c940 comp rx=0 tx=0).stop 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1526455295 shutdown_connections 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f57980aeef0 0x7f57980af380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- 172.21.15.39:0/1526455295 >> v2:172.21.15.102:3300/0 conn(0x7f5798070f40 0x7f5798073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- 172.21.15.39:0/1526455295 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5798068920 0x7f5798141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1526455295 >> 172.21.15.39:0/1526455295 conn(0x7f57980b5da0 msgr2=0x7f57980b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1526455295 shutdown_connections 2024-09-13T11:12:00.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1526455295 wait complete. 2024-09-13T11:12:00.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 Processor -- start 2024-09-13T11:12:00.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- start start 2024-09-13T11:12:00.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5798068920 0x7f579814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 0x7f5798071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f57980aeef0 0x7f57981ded00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5798145270 con 0x7f5798070f40 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57981450f0 con 0x7f5798068920 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f57981453f0 con 0x7f57980aeef0 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 0x7f5798071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 0x7f5798071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52972/0 (socket says 172.21.15.39:52972) 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 -- 172.21.15.39:0/1418863199 learned_addr learned my addr 172.21.15.39:0/1418863199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579ebc5640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f57980aeef0 0x7f57981ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579e3c4640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5798068920 0x7f579814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 -- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f57980aeef0 msgr2=0x7f57981ded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f57980aeef0 0x7f57981ded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 -- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5798068920 msgr2=0x7f579814a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5798068920 0x7f579814a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 -- 172.21.15.39:0/1418863199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57980729f0 con 0x7f5798070f40 2024-09-13T11:12:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f579dbc3640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 0x7f5798071790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f578800d800 tx=0x7f578800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578800b6c0 con 0x7f5798070f40 2024-09-13T11:12:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5788019070 con 0x7f5798070f40 2024-09-13T11:12:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5798072cd0 con 0x7f5798070f40 2024-09-13T11:12:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578800baa0 con 0x7f5798070f40 2024-09-13T11:12:00.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57981df240 con 0x7f5798070f40 2024-09-13T11:12:00.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.047+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5798141150 con 0x7f5798070f40 2024-09-13T11:12:00.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.051+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f578800bc40 con 0x7f5798070f40 2024-09-13T11:12:00.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.051+0000 7f578effd640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f577c072100 0x7f577c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.051+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f5788092c60 con 0x7f5798070f40 2024-09-13T11:12:00.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.051+0000 7f579e3c4640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f577c072100 0x7f577c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.051+0000 7f579e3c4640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f577c072100 0x7f577c0745c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5794009a70 tx=0x7f5794008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.055+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f578805e750 con 0x7f5798070f40 2024-09-13T11:12:00.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.227+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57980b22a0 con 0x7f5798070f40 2024-09-13T11:12:00.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.227+0000 7f578effd640 1 -- 172.21.15.39:0/1418863199 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+14859 (secure 0 0 0) 0x7f578805e050 con 0x7f5798070f40 2024-09-13T11:12:00.231 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:12:00.231 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:11:59.155649+0000","last_up_change":"2024-09-13T11:11:48.073845+0000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T11:11:48.029865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T11:11:55.369110+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6809","nonce":1555151115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6811","nonce":1555151115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6815","nonce":1555151115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6813","nonce":1555151115}]},"public_addr":"172.21.15.39:6809/1555151115","cluster_addr":"172.21.15.39:6811/1555151115","heartbeat_back_addr":"172.21.15.39:6815/1555151115","heartbeat_front_addr":"172.21.15.39:6813/1555151115","state":["exists","up"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6817","nonce":3509723286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6819","nonce":3509723286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6823","nonce":3509723286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6821","nonce":3509723286}]},"public_addr":"172.21.15.39:6817/3509723286","cluster_addr":"172.21.15.39:6819/3509723286","heartbeat_back_addr":"172.21.15.39:6823/3509723286","heartbeat_front_addr":"172.21.15.39:6821/3509723286","state":["exists","up"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6825","nonce":1540683038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6827","nonce":1540683038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6831","nonce":1540683038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6829","nonce":1540683038}]},"public_addr":"172.21.15.39:6825/1540683038","cluster_addr":"172.21.15.39:6827/1540683038","heartbeat_back_addr":"172.21.15.39:6831/1540683038","heartbeat_front_addr":"172.21.15.39:6829/1540683038","state":["exists","up"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6801","nonce":2999541781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6803","nonce":2999541781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6807","nonce":2999541781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6805","nonce":2999541781}]},"public_addr":"172.21.15.39:6801/2999541781","cluster_addr":"172.21.15.39:6803/2999541781","heartbeat_back_addr":"172.21.15.39:6807/2999541781","heartbeat_front_addr":"172.21.15.39:6805/2999541781","state":["exists","up"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6817","nonce":3161248300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6819","nonce":3161248300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6823","nonce":3161248300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6821","nonce":3161248300}]},"public_addr":"172.21.15.102:6817/3161248300","cluster_addr":"172.21.15.102:6819/3161248300","heartbeat_back_addr":"172.21.15.102:6823/3161248300","heartbeat_front_addr":"172.21.15.102:6821/3161248300","state":["exists","up"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6825","nonce":498174754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6827","nonce":498174754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6831","nonce":498174754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6829","nonce":498174754}]},"public_addr":"172.21.15.102:6825/498174754","cluster_addr":"172.21.15.102:6827/498174754","heartbeat_back_addr":"172.21.15.102:6831/498174754","heartbeat_front_addr":"172.21.15.102:6829/498174754","state":["exists","up"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6809","nonce":2547475669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6811","nonce":2547475669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6815","nonce":2547475669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6813","nonce":2547475669}]},"public_addr":"172.21.15.102:6809/2547475669","cluster_addr":"172.21.15.102:6811/2547475669","heartbeat_back_addr":"172.21.15.102:6815/2547475669","heartbeat_front_addr":"172.21.15.102:6813/2547475669","state":["exists","up"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6801","nonce":3217028379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6803","nonce":3217028379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6807","nonce":3217028379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6805","nonce":3217028379}]},"public_addr":"172.21.15.102:6801/3217028379","cluster_addr":"172.21.15.102:6803/3217028379","heartbeat_back_addr":"172.21.15.102:6807/3217028379","heartbeat_front_addr":"172.21.15.102:6805/3217028379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.901346+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.448139+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441429+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.486773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.499628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.879979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.320145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:12:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f577c072100 msgr2=0x7f577c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f577c072100 0x7f577c0745c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5794009a70 tx=0x7f5794008040 comp rx=0 tx=0).stop 2024-09-13T11:12:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 msgr2=0x7f5798071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 0x7f5798071790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f578800d800 tx=0x7f578800dcc0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 shutdown_connections 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f577c072100 0x7f577c0745c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f57980aeef0 0x7f57981ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5798070f40 0x7f5798071790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 --2- 172.21.15.39:0/1418863199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5798068920 0x7f579814a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 >> 172.21.15.39:0/1418863199 conn(0x7f57980b5da0 msgr2=0x7f5798138fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 shutdown_connections 2024-09-13T11:12:00.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.231+0000 7f57a0628640 1 -- 172.21.15.39:0/1418863199 wait complete. 2024-09-13T11:12:00.249 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T11:12:00.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T11:12:00.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 Processor -- start 2024-09-13T11:12:00.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 -- start start 2024-09-13T11:12:00.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f181c0b6470 0x7f181c1437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c1396c0 0x7f181c139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c0ac5a0 con 0x7f181c0aa550 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f181c0b6850 con 0x7f181c0b6470 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.355+0000 7f18219b7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f181c143ee0 con 0x7f181c1396c0 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181a7fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c1396c0 0x7f181c139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181b7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f181c0aa550 0x7f181c0aa9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39490/0 (socket says 172.21.15.39:39490) 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181b7fe640 1 -- 172.21.15.39:0/3425391979 learned_addr learned my addr 172.21.15.39:0/3425391979 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181affd640 1 --2- 172.21.15.39:0/3425391979 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b6470 0x7f181c1437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181a7fc640 1 -- 172.21.15.39:0/3425391979 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b6470 msgr2=0x7f181c1437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181a7fc640 1 --2- 172.21.15.39:0/3425391979 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b6470 0x7f181c1437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181a7fc640 1 -- 172.21.15.39:0/3425391979 >> v1:172.21.15.39:6789/0 conn(0x7f181c0aa550 legacy=0x7f181c0aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181a7fc640 1 -- 172.21.15.39:0/3425391979 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c140e40 con 0x7f181c1396c0 2024-09-13T11:12:00.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181affd640 1 --2- 172.21.15.39:0/3425391979 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b6470 0x7f181c1437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:00.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f181a7fc640 1 --2- 172.21.15.39:0/3425391979 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c1396c0 0x7f181c139ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18040097c0 tx=0x7f180401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe567551c30ab6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f1819ffb640 1 -- 172.21.15.39:0/3425391979 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040b2070 con 0x7f181c1396c0 2024-09-13T11:12:00.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f1819ffb640 1 -- 172.21.15.39:0/3425391979 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040ad640 con 0x7f181c1396c0 2024-09-13T11:12:00.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f1819ffb640 1 -- 172.21.15.39:0/3425391979 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040ada10 con 0x7f181c1396c0 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 -- 172.21.15.39:0/3425391979 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c1396c0 msgr2=0x7f181c139ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 --2- 172.21.15.39:0/3425391979 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c1396c0 0x7f181c139ae0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18040097c0 tx=0x7f180401c480 comp rx=0 tx=0).stop 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 -- 172.21.15.39:0/3425391979 shutdown_connections 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 --2- 172.21.15.39:0/3425391979 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c1396c0 0x7f181c139ae0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 --2- 172.21.15.39:0/3425391979 >> v2:172.21.15.102:3300/0 conn(0x7f181c0b6470 0x7f181c1437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 -- 172.21.15.39:0/3425391979 >> 172.21.15.39:0/3425391979 conn(0x7f181c0b9650 msgr2=0x7f181c0b9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 -- 172.21.15.39:0/3425391979 shutdown_connections 2024-09-13T11:12:00.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.359+0000 7f18219b7640 1 -- 172.21.15.39:0/3425391979 wait complete. 2024-09-13T11:12:00.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 Processor -- start 2024-09-13T11:12:00.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- start start 2024-09-13T11:12:00.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0aa550 0x7f181c13ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 0x7f181c13b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f181c1396c0 0x7f181c1db6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f181c1507c0 con 0x7f181c1396c0 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f181c150640 con 0x7f181c0aa550 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f181c150940 con 0x7f181c0b6470 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 0x7f181c13b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f181c1396c0 0x7f181c1db6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 0x7f181c13b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53134/0 (socket says 172.21.15.39:53134) 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 -- 172.21.15.39:0/1293853868 learned_addr learned my addr 172.21.15.39:0/1293853868 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181affd640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0aa550 0x7f181c13ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 -- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0aa550 msgr2=0x7f181c13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0aa550 0x7f181c13ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 -- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f181c1396c0 msgr2=0x7f181c1db6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f181c1396c0 0x7f181c1db6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 -- 172.21.15.39:0/1293853868 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c13ce00 con 0x7f181c0b6470 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181b7fe640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f181c1396c0 0x7f181c1db6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f181a7fc640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 0x7f181c13b6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f180401a0b0 tx=0x7f1804019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040bc020 con 0x7f181c0b6470 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040b8620 con 0x7f181c0b6470 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c13d070 con 0x7f181c0b6470 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040b2040 con 0x7f181c0b6470 2024-09-13T11:12:00.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c13bbf0 con 0x7f181c0b6470 2024-09-13T11:12:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c13be20 con 0x7f181c0b6470 2024-09-13T11:12:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.363+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f18040bf020 con 0x7f181c0b6470 2024-09-13T11:12:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.367+0000 7f1813fff640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f17fc072100 0x7f17fc0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.367+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f180412cfd0 con 0x7f181c0b6470 2024-09-13T11:12:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.367+0000 7f181affd640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f17fc072100 0x7f17fc0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.367+0000 7f181affd640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f17fc072100 0x7f17fc0745c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f180c00a9a0 tx=0x7f180c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.367+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f18040c6030 con 0x7f181c0b6470 2024-09-13T11:12:00.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f181c0768e0 con 0x7f181c0b6470 2024-09-13T11:12:00.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f1813fff640 1 -- 172.21.15.39:0/1293853868 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+14859 (secure 0 0 0) 0x7f181c13d070 con 0x7f181c0b6470 2024-09-13T11:12:00.540 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:12:00.541 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":20,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:11:59.155649+0000","last_up_change":"2024-09-13T11:11:48.073845+0000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T11:11:48.029865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T11:11:55.369110+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6809","nonce":1555151115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6811","nonce":1555151115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6815","nonce":1555151115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6813","nonce":1555151115}]},"public_addr":"172.21.15.39:6809/1555151115","cluster_addr":"172.21.15.39:6811/1555151115","heartbeat_back_addr":"172.21.15.39:6815/1555151115","heartbeat_front_addr":"172.21.15.39:6813/1555151115","state":["exists","up"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6817","nonce":3509723286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6819","nonce":3509723286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6823","nonce":3509723286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6821","nonce":3509723286}]},"public_addr":"172.21.15.39:6817/3509723286","cluster_addr":"172.21.15.39:6819/3509723286","heartbeat_back_addr":"172.21.15.39:6823/3509723286","heartbeat_front_addr":"172.21.15.39:6821/3509723286","state":["exists","up"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6825","nonce":1540683038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6827","nonce":1540683038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6831","nonce":1540683038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6829","nonce":1540683038}]},"public_addr":"172.21.15.39:6825/1540683038","cluster_addr":"172.21.15.39:6827/1540683038","heartbeat_back_addr":"172.21.15.39:6831/1540683038","heartbeat_front_addr":"172.21.15.39:6829/1540683038","state":["exists","up"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6801","nonce":2999541781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6803","nonce":2999541781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6807","nonce":2999541781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6805","nonce":2999541781}]},"public_addr":"172.21.15.39:6801/2999541781","cluster_addr":"172.21.15.39:6803/2999541781","heartbeat_back_addr":"172.21.15.39:6807/2999541781","heartbeat_front_addr":"172.21.15.39:6805/2999541781","state":["exists","up"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6817","nonce":3161248300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6819","nonce":3161248300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6823","nonce":3161248300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6821","nonce":3161248300}]},"public_addr":"172.21.15.102:6817/3161248300","cluster_addr":"172.21.15.102:6819/3161248300","heartbeat_back_addr":"172.21.15.102:6823/3161248300","heartbeat_front_addr":"172.21.15.102:6821/3161248300","state":["exists","up"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6825","nonce":498174754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6827","nonce":498174754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6831","nonce":498174754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6829","nonce":498174754}]},"public_addr":"172.21.15.102:6825/498174754","cluster_addr":"172.21.15.102:6827/498174754","heartbeat_back_addr":"172.21.15.102:6831/498174754","heartbeat_front_addr":"172.21.15.102:6829/498174754","state":["exists","up"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6809","nonce":2547475669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6811","nonce":2547475669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6815","nonce":2547475669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6813","nonce":2547475669}]},"public_addr":"172.21.15.102:6809/2547475669","cluster_addr":"172.21.15.102:6811/2547475669","heartbeat_back_addr":"172.21.15.102:6815/2547475669","heartbeat_front_addr":"172.21.15.102:6813/2547475669","state":["exists","up"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6801","nonce":3217028379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6803","nonce":3217028379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6807","nonce":3217028379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6805","nonce":3217028379}]},"public_addr":"172.21.15.102:6801/3217028379","cluster_addr":"172.21.15.102:6803/3217028379","heartbeat_back_addr":"172.21.15.102:6807/3217028379","heartbeat_front_addr":"172.21.15.102:6805/3217028379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.901346+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.448139+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441429+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.486773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.499628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.879979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.320145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f17fc072100 msgr2=0x7f17fc0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f17fc072100 0x7f17fc0745c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f180c00a9a0 tx=0x7f180c008040 comp rx=0 tx=0).stop 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 msgr2=0x7f181c13b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 0x7f181c13b6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f180401a0b0 tx=0x7f1804019220 comp rx=0 tx=0).stop 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 shutdown_connections 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f17fc072100 0x7f17fc0745c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f181c1396c0 0x7f181c1db6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f181c0b6470 0x7f181c13b6b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 --2- 172.21.15.39:0/1293853868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f181c0aa550 0x7f181c13ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 >> 172.21.15.39:0/1293853868 conn(0x7f181c0b9650 msgr2=0x7f181c1386b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 shutdown_connections 2024-09-13T11:12:00.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.539+0000 7f18219b7640 1 -- 172.21.15.39:0/1293853868 wait complete. 2024-09-13T11:12:00.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T11:12:00.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T11:12:00.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T11:12:00.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T11:12:00.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T11:12:00.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T11:12:00.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T11:12:00.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T11:12:00.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.731+0000 7f3784ab6640 1 Processor -- start 2024-09-13T11:12:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f3784ab6640 1 -- start start 2024-09-13T11:12:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f3784ab6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3780070ab0 0x7f378013f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f3784ab6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f378013caa0 0x7f378013f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f3784ab6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3780072c80 con 0x7f37800706d0 2024-09-13T11:12:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f3784ab6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3780074510 con 0x7f378013caa0 2024-09-13T11:12:00.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f3784ab6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f3780072a30 con 0x7f3780070ab0 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377e59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f37800706d0 0x7f378013c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39502/0 (socket says 172.21.15.39:39502) 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377e59c640 1 -- 172.21.15.39:0/3281880709 learned_addr learned my addr 172.21.15.39:0/3281880709 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377dd9b640 1 --2- 172.21.15.39:0/3281880709 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3780070ab0 0x7f378013f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377ed9d640 1 --2- 172.21.15.39:0/3281880709 >> v2:172.21.15.102:3300/0 conn(0x7f378013caa0 0x7f378013f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377dd9b640 1 -- 172.21.15.39:0/3281880709 >> v2:172.21.15.102:3300/0 conn(0x7f378013caa0 msgr2=0x7f378013f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377dd9b640 1 --2- 172.21.15.39:0/3281880709 >> v2:172.21.15.102:3300/0 conn(0x7f378013caa0 0x7f378013f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377dd9b640 1 -- 172.21.15.39:0/3281880709 >> v1:172.21.15.39:6789/0 conn(0x7f37800706d0 legacy=0x7f378013c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f377dd9b640 1 -- 172.21.15.39:0/3281880709 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378013cf00 con 0x7f3780070ab0 2024-09-13T11:12:00.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.735+0000 7f361192f640 1 Processor -- start 2024-09-13T11:12:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f361192f640 1 -- start start 2024-09-13T11:12:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f377dd9b640 1 --2- 172.21.15.39:0/3281880709 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3780070ab0 0x7f378013f3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3770010ba0 tx=0x7f3770020980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1c66b314c4abc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f361192f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3604031870 0x7f360402fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f361192f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36040325c0 con 0x7f3604034620 2024-09-13T11:12:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f361192f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36040cc7c0 con 0x7f36040c8c50 2024-09-13T11:12:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f361192f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f3604034a00 con 0x7f3604031870 2024-09-13T11:12:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8759e640 1 Processor -- start 2024-09-13T11:12:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360affd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3604034620 0x7f36040cc0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39508/0 (socket says 172.21.15.39:39508) 2024-09-13T11:12:00.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360affd640 1 -- 172.21.15.39:0/1996905783 learned_addr learned my addr 172.21.15.39:0/1996905783 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:00.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 Processor -- start 2024-09-13T11:12:00.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360a7fc640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3604031870 0x7f360402fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 -- start start 2024-09-13T11:12:00.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443496917 0 0) 0x7f36040325c0 con 0x7f3604034620 2024-09-13T11:12:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f377d59a640 1 -- 172.21.15.39:0/3281880709 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37700af070 con 0x7f3780070ab0 2024-09-13T11:12:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f377d59a640 1 -- 172.21.15.39:0/3281880709 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37700a9970 con 0x7f3780070ab0 2024-09-13T11:12:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f377d59a640 1 -- 172.21.15.39:0/3281880709 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37700a9d40 con 0x7f3780070ab0 2024-09-13T11:12:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f4003530 con 0x7f3604034620 2024-09-13T11:12:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686523062 0 0) 0x7f36040cc7c0 con 0x7f36040c8c50 2024-09-13T11:12:00.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36040325c0 con 0x7f36040c8c50 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716148494 0 0) 0x7f35f4003530 con 0x7f3604034620 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3604031870 msgr2=0x7f360402fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 -- 172.21.15.39:0/3281880709 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3780070ab0 msgr2=0x7f378013f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 --2- 172.21.15.39:0/3281880709 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3780070ab0 0x7f378013f3c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3770010ba0 tx=0x7f3770020980 comp rx=0 tx=0).stop 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb528071620 0x7fb528072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 0x7fb528150080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5280706c0 con 0x7fb52808cad0 2024-09-13T11:12:00.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb528072350 con 0x7fb528071620 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52fad7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fb5280709f0 con 0x7fb5280af8b0 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52d873640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb528071620 0x7fb528072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 0x7fb528150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 -- 172.21.15.39:0/3281880709 shutdown_connections 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 --2- 172.21.15.39:0/3281880709 >> v2:172.21.15.102:3300/0 conn(0x7f378013caa0 0x7f378013f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 --2- 172.21.15.39:0/3281880709 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3780070ab0 0x7f378013f3c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 -- 172.21.15.39:0/3281880709 >> 172.21.15.39:0/3281880709 conn(0x7f37800b4eb0 msgr2=0x7f37800b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8759e640 1 -- start start 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8759e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d800345f0 0x7f5d800c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8759e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d80032c20 con 0x7f5d800c4300 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d8002c710 con 0x7f5d800cbd50 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8759e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5d800349d0 con 0x7f5d800345f0 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3604031870 0x7f360402fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 >> v1:172.21.15.102:6789/0 conn(0x7f36040c8c50 legacy=0x7f36040d6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3604032830 con 0x7f3604034620 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f3600001680 con 0x7f3604034620 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 >> v1:172.21.15.39:6789/0 conn(0x7f3604034620 legacy=0x7f36040cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f4003b80 0x7f35f4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35f4004810 0x7f35f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f35f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f35f400c0a0 con 0x7f35f4004810 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35f400c220 con 0x7f35f4003b80 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f35f400c420 con 0x7f35f40051d0 2024-09-13T11:12:00.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360a7fc640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3604031870 0x7f360402fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 -- 172.21.15.39:0/3281880709 shutdown_connections 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f3784ab6640 1 -- 172.21.15.39:0/3281880709 wait complete. 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360b7fe640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f35f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8659c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d800345f0 0x7f5d800c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d85d9b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5d800c4300 0x7f5d800317c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39514/0 (socket says 172.21.15.39:39514) 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8659c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5d800345f0 0x7f5d800c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52990/0 (socket says 172.21.15.39:52990) 2024-09-13T11:12:00.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d85d9b640 1 -- 172.21.15.39:0/2527156446 learned_addr learned my addr 172.21.15.39:0/2527156446 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360b7fe640 1 -- 172.21.15.39:0/1996905783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f4003b80 msgr2=0x7f35f4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360b7fe640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35f4003b80 0x7f35f4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360b7fe640 1 -- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35f4004810 msgr2=0x7f35f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360a7fc640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35f4004810 0x7f35f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360b7fe640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35f4004810 0x7f35f4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360b7fe640 1 -- 172.21.15.39:0/1996905783 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f4003530 con 0x7f35f40051d0 2024-09-13T11:12:00.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f360a7fc640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f35f4004810 0x7f35f4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 0x7fb528150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53172/0 (socket says 172.21.15.39:53172) 2024-09-13T11:12:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 -- 172.21.15.39:0/300346918 learned_addr learned my addr 172.21.15.39:0/300346918 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 -- 172.21.15.39:0/300346918 >> v2:172.21.15.102:3300/0 conn(0x7fb528071620 msgr2=0x7fb528072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 --2- 172.21.15.39:0/300346918 >> v2:172.21.15.102:3300/0 conn(0x7fb528071620 0x7fb528072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 Processor -- start 2024-09-13T11:12:00.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 -- 172.21.15.39:0/300346918 >> v1:172.21.15.39:6789/0 conn(0x7fb52808cad0 legacy=0x7fb528150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7fb52e074640 1 -- 172.21.15.39:0/300346918 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528072580 con 0x7fb5280af8b0 2024-09-13T11:12:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 Processor -- start 2024-09-13T11:12:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8659c640 1 -- 172.21.15.39:0/2527156446 >> v1:172.21.15.102:6789/0 conn(0x7f5d800cbd50 legacy=0x7f5d800ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8659c640 1 -- 172.21.15.39:0/2527156446 >> v1:172.21.15.39:6789/0 conn(0x7f5d800c4300 legacy=0x7f5d800317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.739+0000 7f5d8659c640 1 -- 172.21.15.39:0/2527156446 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d80031220 con 0x7f5d800345f0 2024-09-13T11:12:00.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 -- start start 2024-09-13T11:12:00.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 Processor -- start 2024-09-13T11:12:00.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 -- start start 2024-09-13T11:12:00.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37800706d0 0x7f3780142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3780070ab0 0x7f37800ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f378013caa0 0x7f3780138b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f378014ca20 con 0x7f37800706d0 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f378014c8a0 con 0x7f3780070ab0 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3784ab6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f378014cba0 con 0x7f378013caa0 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f378013caa0 0x7f3780138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f378013caa0 0x7f3780138b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53184/0 (socket says 172.21.15.39:53184) 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 -- 172.21.15.39:0/2567379519 learned_addr learned my addr 172.21.15.39:0/2567379519 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 -- start start 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54070400 0x7fae540707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fae54145040 0x7fae54147960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae54147ea0 con 0x7fae54074680 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fae54071420 con 0x7fae54145040 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae5ae62640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fae540716e0 con 0x7fae54070400 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 -- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3780070ab0 msgr2=0x7f37800ac080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3780070ab0 0x7f37800ac080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 -- 172.21.15.39:0/2567379519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37800706d0 msgr2=0x7f3780142800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T11:12:00.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37800706d0 0x7f3780142800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 -- 172.21.15.39:0/2567379519 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37800add00 con 0x7f378013caa0 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae53fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fae54074680 0x7fae54144930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39528/0 (socket says 172.21.15.39:39528) 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae53fff640 1 -- 172.21.15.39:0/2465514536 learned_addr learned my addr 172.21.15.39:0/2465514536 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f568402d200 0x7f5684144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f568402d5e0 0x7f5684141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56840b2490 con 0x7f56841450f0 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f56841455e0 con 0x7f568402d200 2024-09-13T11:12:00.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568892e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f5684073420 con 0x7f568402d5e0 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae593ff640 1 --2- 172.21.15.39:0/2465514536 >> v2:172.21.15.102:3300/0 conn(0x7fae54145040 0x7fae54147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae537fe640 1 -- 172.21.15.39:0/2465514536 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285623120 0 0) 0x7fae54147ea0 con 0x7fae54074680 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae537fe640 1 -- 172.21.15.39:0/2465514536 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae3c003530 con 0x7fae54074680 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae58bfe640 1 --2- 172.21.15.39:0/2465514536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54070400 0x7fae540707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f568402d200 0x7f5684144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f568402d200 0x7f5684144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52996/0 (socket says 172.21.15.39:52996) 2024-09-13T11:12:00.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 -- 172.21.15.39:0/2803366065 learned_addr learned my addr 172.21.15.39:0/2803366065 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f5d8659c640 1 --2- 172.21.15.39:0/2527156446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800345f0 0x7f5d800c3dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00a960 tx=0x7f5d7c01e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255730e7693b015f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f360b7fe640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f35f400b9d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f360c06c390 tx=0x7f360c0986f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971567f32063cbc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f5d8559a640 1 -- 172.21.15.39:0/2527156446 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0b4070 con 0x7f5d800345f0 2024-09-13T11:12:00.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f377ed9d640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f378013caa0 0x7f3780138b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3778007d40 tx=0x7f377800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f5681d9b640 1 --2- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f568402d5e0 0x7f5684141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f5d8559a640 1 -- 172.21.15.39:0/2527156446 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0a7710 con 0x7f5d800345f0 2024-09-13T11:12:00.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 -- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f568402d5e0 msgr2=0x7f5684141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 --2- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f568402d5e0 0x7f5684141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 -- 172.21.15.39:0/2803366065 >> v1:172.21.15.102:6789/0 conn(0x7f56841450f0 legacy=0x7f5684141a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T11:12:00.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f568259c640 1 -- 172.21.15.39:0/2803366065 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840735f0 con 0x7f568402d200 2024-09-13T11:12:00.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f5d8559a640 1 -- 172.21.15.39:0/2527156446 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00b040 con 0x7f5d800345f0 2024-09-13T11:12:00.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fb52e074640 1 --2- 172.21.15.39:0/300346918 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 0x7fb528150080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb528070b70 tx=0x7fb520025200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd688aa67f3210b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c0643b0 con 0x7f35f40051d0 2024-09-13T11:12:00.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c127680 con 0x7f35f40051d0 2024-09-13T11:12:00.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f3609ffb640 1 -- 172.21.15.39:0/1996905783 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c127b30 con 0x7f35f40051d0 2024-09-13T11:12:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52c871640 1 -- 172.21.15.39:0/300346918 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5200b9070 con 0x7fb5280af8b0 2024-09-13T11:12:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52c871640 1 -- 172.21.15.39:0/300346918 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5200b4600 con 0x7fb5280af8b0 2024-09-13T11:12:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52c871640 1 -- 172.21.15.39:0/300346918 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5200b49d0 con 0x7fb5280af8b0 2024-09-13T11:12:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778014420 con 0x7f378013caa0 2024-09-13T11:12:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3778019070 con 0x7f378013caa0 2024-09-13T11:12:00.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778014800 con 0x7f378013caa0 2024-09-13T11:12:00.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- 172.21.15.39:0/2527156446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800345f0 msgr2=0x7f5d800c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 --2- 172.21.15.39:0/2527156446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800345f0 0x7f5d800c3dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00a960 tx=0x7f5d7c01e840 comp rx=0 tx=0).stop 2024-09-13T11:12:00.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f3784ab6640 1 -- 172.21.15.39:0/2567379519 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37800ac990 con 0x7f378013caa0 2024-09-13T11:12:00.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f3784ab6640 1 -- 172.21.15.39:0/2567379519 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3780139090 con 0x7f378013caa0 2024-09-13T11:12:00.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f361192f640 1 -- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 msgr2=0x7f35f400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f361192f640 1 --2- 172.21.15.39:0/1996905783 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f35f400b9d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f360c06c390 tx=0x7f360c0986f0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f360b7fe640 1 -- 172.21.15.39:0/1996905783 reap_dead start 2024-09-13T11:12:00.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- 172.21.15.39:0/2527156446 shutdown_connections 2024-09-13T11:12:00.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 --2- 172.21.15.39:0/2527156446 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800345f0 0x7f5d800c3dc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- 172.21.15.39:0/2527156446 >> 172.21.15.39:0/2527156446 conn(0x7f5d80005c30 msgr2=0x7f5d80006040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- 172.21.15.39:0/2527156446 shutdown_connections 2024-09-13T11:12:00.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 -- 172.21.15.39:0/300346918 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 msgr2=0x7fb528150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 --2- 172.21.15.39:0/300346918 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 0x7fb528150080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb528070b70 tx=0x7fb520025200 comp rx=0 tx=0).stop 2024-09-13T11:12:00.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f928093a640 1 Processor -- start 2024-09-13T11:12:00.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f3784ab6640 1 -- 172.21.15.39:0/2567379519 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37800ac790 con 0x7f378013caa0 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 -- 172.21.15.39:0/300346918 shutdown_connections 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 --2- 172.21.15.39:0/300346918 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb5280af8b0 0x7fb528150080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 --2- 172.21.15.39:0/300346918 >> v2:172.21.15.102:3300/0 conn(0x7fb528071620 0x7fb528072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 -- 172.21.15.39:0/300346918 >> 172.21.15.39:0/300346918 conn(0x7fb5280b4eb0 msgr2=0x7fb5280b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f928093a640 1 -- start start 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f928093a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f927c14b850 0x7f927c144770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f928093a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c072980 con 0x7f927c144cb0 2024-09-13T11:12:00.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f928093a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f927c071050 con 0x7f927c0703d0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f928093a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f927c070b90 con 0x7f927c14b850 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f927bfff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f927c144cb0 0x7f927c1524e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39538/0 (socket says 172.21.15.39:39538) 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7f927bfff640 1 -- 172.21.15.39:0/1593949771 learned_addr learned my addr 172.21.15.39:0/1593949771 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667854785 0 0) 0x7f927c072980 con 0x7f927c144cb0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9264003530 con 0x7f927c144cb0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28754332 0 0) 0x7f927c071050 con 0x7f927c0703d0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f927c072980 con 0x7f927c0703d0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4163225611 0 0) 0x7f9264003530 con 0x7f927c144cb0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 >> v2:172.21.15.102:3300/0 conn(0x7f927c14b850 msgr2=0x7f927c144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927affd640 1 --2- 172.21.15.39:0/1593949771 >> v2:172.21.15.102:3300/0 conn(0x7f927c14b850 0x7f927c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 --2- 172.21.15.39:0/1593949771 >> v2:172.21.15.102:3300/0 conn(0x7f927c14b850 0x7f927c144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 >> v1:172.21.15.102:6789/0 conn(0x7f927c0703d0 legacy=0x7f927c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c0714a0 con 0x7f927c144cb0 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- 172.21.15.39:0/2527156446 wait complete. 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 Processor -- start 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f9274001a80 con 0x7f927c144cb0 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 >> v1:172.21.15.39:6789/0 conn(0x7f927c144cb0 legacy=0x7f927c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9264003c40 0x7f9264004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264004810 0x7f9264004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92640053d0 0x7f926400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f927c070b90 con 0x7f9264004810 2024-09-13T11:12:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f926400c270 con 0x7f92640053d0 2024-09-13T11:12:00.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f926400c470 con 0x7f9264003c40 2024-09-13T11:12:00.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- start start 2024-09-13T11:12:00.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae58bfe640 1 -- 172.21.15.39:0/2465514536 >> v2:172.21.15.102:3300/0 conn(0x7fae54145040 msgr2=0x7fae54147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae58bfe640 1 --2- 172.21.15.39:0/2465514536 >> v2:172.21.15.102:3300/0 conn(0x7fae54145040 0x7fae54147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae58bfe640 1 -- 172.21.15.39:0/2465514536 >> v1:172.21.15.39:6789/0 conn(0x7fae54074680 legacy=0x7fae54144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.743+0000 7fae58bfe640 1 -- 172.21.15.39:0/2465514536 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae54148070 con 0x7fae54070400 2024-09-13T11:12:00.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927b7fe640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9264003c40 0x7f9264004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927bfff640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92640053d0 0x7f926400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927affd640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264004810 0x7f9264004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fae58bfe640 1 --2- 172.21.15.39:0/2465514536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54070400 0x7fae540707e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009d90 tx=0x7fae4c01c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d224eddfa4c286 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d800345f0 0x7f5d800c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800c4300 0x7f5d800ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d800cbd50 0x7f5d80170610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80031ed0 con 0x7f5d800c4300 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80032050 con 0x7f5d800345f0 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8759e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f5d800d2490 con 0x7f5d800cbd50 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f361192f640 1 -- 172.21.15.39:0/1996905783 shutdown_connections 2024-09-13T11:12:00.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f361192f640 1 -- 172.21.15.39:0/1996905783 >> 172.21.15.39:0/1996905783 conn(0x7f3604005c60 msgr2=0x7f3604006070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fb52fad7640 1 -- 172.21.15.39:0/300346918 shutdown_connections 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d85d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800c4300 0x7f5d800ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d85d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800c4300 0x7f5d800ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53012/0 (socket says 172.21.15.39:53012) 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d85d9b640 1 -- 172.21.15.39:0/2326697950 learned_addr learned my addr 172.21.15.39:0/2326697950 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927b7fe640 1 -- 172.21.15.39:0/1593949771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92640053d0 msgr2=0x7f926400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927b7fe640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92640053d0 0x7f926400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927b7fe640 1 -- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264004810 msgr2=0x7f9264004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f72029ce640 1 Processor -- start 2024-09-13T11:12:00.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d86d9d640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d800cbd50 0x7f5d80170610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f568259c640 1 --2- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f568402d200 0x7f5684144bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5674009870 tx=0x7f567401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db95bf389a26e335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f361192f640 1 -- 172.21.15.39:0/1996905783 shutdown_connections 2024-09-13T11:12:00.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f361192f640 1 -- 172.21.15.39:0/1996905783 wait complete. 2024-09-13T11:12:00.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f5d8659c640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d800345f0 0x7f5d800c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927b7fe640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264004810 0x7f9264004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927b7fe640 1 -- 172.21.15.39:0/1593949771 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c0714a0 con 0x7f9264003c40 2024-09-13T11:12:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fae537fe640 1 -- 172.21.15.39:0/2465514536 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48001700 con 0x7fae54070400 2024-09-13T11:12:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fae537fe640 1 -- 172.21.15.39:0/2465514536 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4c0af070 con 0x7fae54070400 2024-09-13T11:12:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7fae537fe640 1 -- 172.21.15.39:0/2465514536 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0aa610 con 0x7fae54070400 2024-09-13T11:12:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f927affd640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264004810 0x7f9264004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:00.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fb52fad7640 1 -- 172.21.15.39:0/300346918 wait complete. 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d85d9b640 1 -- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d800cbd50 msgr2=0x7f5d80170610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d85d9b640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5d800cbd50 0x7f5d80170610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d85d9b640 1 -- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d800345f0 msgr2=0x7f5d800c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d85d9b640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d800345f0 0x7f5d800c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d85d9b640 1 -- 172.21.15.39:0/2326697950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d800c8700 con 0x7f5d800c4300 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d85d9b640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800c4300 0x7f5d800ce300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c8b0 tx=0x7f5d7800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f927bfff640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f92640053d0 0x7f926400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:12:00.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f72029ce640 1 -- start start 2024-09-13T11:12:00.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f72029ce640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f71f40071d0 0x7f71f40311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f72029ce640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 0x7f71f40347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f927bfff640 1 -- 172.21.15.39:0/1593949771 reap_dead start 2024-09-13T11:12:00.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f72029ce640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f4032b30 con 0x7f71f402ed10 2024-09-13T11:12:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78015020 con 0x7f5d800c4300 2024-09-13T11:12:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78007a30 con 0x7f5d800c4300 2024-09-13T11:12:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78007e20 con 0x7f5d800c4300 2024-09-13T11:12:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 -- 172.21.15.39:0/2465514536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54070400 msgr2=0x7fae540707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 --2- 172.21.15.39:0/2465514536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54070400 0x7fae540707e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009d90 tx=0x7fae4c01c700 comp rx=0 tx=0).stop 2024-09-13T11:12:00.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d800c6610 con 0x7f5d800c4300 2024-09-13T11:12:00.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d800c7b20 con 0x7f5d800c4300 2024-09-13T11:12:00.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f72029ce640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f71f40075b0 con 0x7f71f40071d0 2024-09-13T11:12:00.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f72029ce640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f71f4032da0 con 0x7f71f402fa00 2024-09-13T11:12:00.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 Processor -- start 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 0x7f71f40347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 0x7f71f40347e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53216/0 (socket says 172.21.15.39:53216) 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 -- 172.21.15.39:0/2476879434 learned_addr learned my addr 172.21.15.39:0/2476879434 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 -- start start 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f360402aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36040d6960 0x7f3604167a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3604167fa0 0x7f36040c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f36040d82b0 con 0x7f36040d6960 2024-09-13T11:12:00.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f36040c9560 con 0x7f3604167fa0 2024-09-13T11:12:00.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f361192f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f36040d8430 con 0x7f35f40051d0 2024-09-13T11:12:00.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3604167fa0 0x7f36040c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fb52fad7640 1 Processor -- start 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5d800c3dc0 con 0x7f5d800c4300 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f37780149a0 con 0x7f378013caa0 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f376effd640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f37600721d0 0x7f3760074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.747+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f3778092f70 con 0x7f378013caa0 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f376effd640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f3760078610 0x7f376007aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 --> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f377800be50 con 0x7f3760078610 2024-09-13T11:12:00.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f377dd9b640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f3760078610 0x7f376007aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f377e59c640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f37600721d0 0x7f3760074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 -- 172.21.15.39:0/2465514536 shutdown_connections 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 --2- 172.21.15.39:0/2465514536 >> v2:172.21.15.102:3300/0 conn(0x7fae54145040 0x7fae54147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 --2- 172.21.15.39:0/2465514536 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54070400 0x7fae540707e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 -- 172.21.15.39:0/2465514536 >> 172.21.15.39:0/2465514536 conn(0x7fae540b5140 msgr2=0x7fae540b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 -- 172.21.15.39:0/2476879434 >> v2:172.21.15.102:3300/0 conn(0x7f71f40071d0 msgr2=0x7f71f40311f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 --2- 172.21.15.39:0/2476879434 >> v2:172.21.15.102:3300/0 conn(0x7f71f40071d0 0x7f71f40311f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 -- 172.21.15.39:0/2476879434 >> v1:172.21.15.39:6789/0 conn(0x7f71f402ed10 legacy=0x7f71f40ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:00.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568159a640 1 -- 172.21.15.39:0/2803366065 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56740b0070 con 0x7f568402d200 2024-09-13T11:12:00.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568159a640 1 -- 172.21.15.39:0/2803366065 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56740ab600 con 0x7f568402d200 2024-09-13T11:12:00.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568159a640 1 -- 172.21.15.39:0/2803366065 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56740ab9d0 con 0x7f568402d200 2024-09-13T11:12:00.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3604167fa0 0x7f36040c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:58938/0 (socket says 172.21.15.39:58938) 2024-09-13T11:12:00.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360b7fe640 1 -- 172.21.15.39:0/97988523 learned_addr learned my addr 172.21.15.39:0/97988523 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f927b7fe640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9264003c40 0x7f9264004040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f926c001930 tx=0x7f926c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b96ef36d6218c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f71fb7fe640 1 -- 172.21.15.39:0/2476879434 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f4030be0 con 0x7f71f402fa00 2024-09-13T11:12:00.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 -- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f568402d200 msgr2=0x7f5684144bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 --2- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f568402d200 0x7f5684144bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5674009870 tx=0x7f567401c420 comp rx=0 tx=0).stop 2024-09-13T11:12:00.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 -- 172.21.15.39:0/2803366065 shutdown_connections 2024-09-13T11:12:00.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 --2- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f568402d5e0 0x7f5684141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 --2- 172.21.15.39:0/2803366065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f568402d200 0x7f5684144bb0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5674009870 tx=0x7f567401c420 comp rx=0 tx=0).stop 2024-09-13T11:12:00.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f360402aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 -- 172.21.15.39:0/2803366065 >> 172.21.15.39:0/2803366065 conn(0x7f56840b2f50 msgr2=0x7f568406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 -- 172.21.15.39:0/2465514536 shutdown_connections 2024-09-13T11:12:00.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c001550 con 0x7f9264003c40 2024-09-13T11:12:00.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0052d0 con 0x7f9264003c40 2024-09-13T11:12:00.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f927a7fc640 1 -- 172.21.15.39:0/1593949771 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c0054c0 con 0x7f9264003c40 2024-09-13T11:12:00.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f377dd9b640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f3760078610 0x7f376007aa50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 -- 172.21.15.39:0/2803366065 shutdown_connections 2024-09-13T11:12:00.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f568892e640 1 -- 172.21.15.39:0/2803366065 wait complete. 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 -- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3604167fa0 msgr2=0x7f36040c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3604167fa0 0x7f36040c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 -- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36040d6960 msgr2=0x7f3604167a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f36040d6960 0x7f3604167a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 -- 172.21.15.39:0/97988523 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360402b790 con 0x7f35f40051d0 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fae5ae62640 1 -- 172.21.15.39:0/2465514536 wait complete. 2024-09-13T11:12:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7fb52fad7640 1 -- start start 2024-09-13T11:12:00.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f360affd640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f360402aaf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f360000c760 tx=0x7f360000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f377805aa30 con 0x7f378013caa0 2024-09-13T11:12:00.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9264003c40 msgr2=0x7f9264004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9264003c40 0x7f9264004040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f926c001930 tx=0x7f926c01ec90 comp rx=0 tx=0).stop 2024-09-13T11:12:00.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- 172.21.15.39:0/1593949771 shutdown_connections 2024-09-13T11:12:00.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 --2- 172.21.15.39:0/1593949771 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9264003c40 0x7f9264004040 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- 172.21.15.39:0/1593949771 >> 172.21.15.39:0/1593949771 conn(0x7f927c0b4d40 msgr2=0x7f927c0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 Processor -- start 2024-09-13T11:12:00.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- 172.21.15.39:0/1593949771 shutdown_connections 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb528071620 0x7fb5280b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb52808cad0 0x7fb52808a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280af8b0 0x7fb52808a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb5281552b0 con 0x7fb52808cad0 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb528155130 con 0x7fb5280af8b0 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fb528155430 con 0x7fb528071620 2024-09-13T11:12:00.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 Processor -- start 2024-09-13T11:12:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb528071620 0x7fb5280b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.751+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f5d78018020 con 0x7f5d800c4300 2024-09-13T11:12:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d76ffd640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5d68072100 0x7f5d680745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb528071620 0x7fb5280b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53238/0 (socket says 172.21.15.39:53238) 2024-09-13T11:12:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f5d78092940 con 0x7f5d800c4300 2024-09-13T11:12:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d76ffd640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f5d68078540 0x7f5d6807a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 --> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d6807b050 con 0x7f5d68078540 2024-09-13T11:12:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 -- start start 2024-09-13T11:12:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 -- 172.21.15.39:0/455359503 learned_addr learned my addr 172.21.15.39:0/455359503 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52e074640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280af8b0 0x7fb52808a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d8659c640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5d68072100 0x7f5d680745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 -- start start 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae54070400 0x7fae540ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54074680 0x7fae541ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae54145040 0x7fae541ec360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae54152c60 con 0x7fae54145040 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fae54152ae0 con 0x7fae54070400 2024-09-13T11:12:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae5ae62640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fae54152de0 con 0x7fae54074680 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54074680 0x7fae541ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54074680 0x7fae541ebe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53246/0 (socket says 172.21.15.39:53246) 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 -- 172.21.15.39:0/3950526402 learned_addr learned my addr 172.21.15.39:0/3950526402 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56841450f0 0x7f56840ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56840abaf0 0x7f5684148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5684148fd0 0x7f568413d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f568414c640 con 0x7f56840abaf0 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f568414c4c0 con 0x7f56841450f0 2024-09-13T11:12:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f568892e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f568414c7c0 con 0x7f5684148fd0 2024-09-13T11:12:00.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d072640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb52808cad0 0x7fb52808a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae593ff640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae54145040 0x7fae541ec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5d7805a430 con 0x7f5d800c4300 2024-09-13T11:12:00.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d86d9d640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f5d68078540 0x7f5d6807a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 -- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280af8b0 msgr2=0x7fb52808a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5280af8b0 0x7fb52808a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 -- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb52808cad0 msgr2=0x7fb52808a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb52808cad0 0x7fb52808a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 -- 172.21.15.39:0/455359503 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52808c340 con 0x7fb528071620 2024-09-13T11:12:00.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f377e59c640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f37600721d0 0x7f3760074690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f377400a790 tx=0x7f3774005c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- 172.21.15.39:0/1593949771 wait complete. 2024-09-13T11:12:00.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 Processor -- start 2024-09-13T11:12:00.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5682d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5684148fd0 0x7f568413d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5682d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5684148fd0 0x7f568413d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53254/0 (socket says 172.21.15.39:53254) 2024-09-13T11:12:00.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5682d9d640 1 -- 172.21.15.39:0/2617555448 learned_addr learned my addr 172.21.15.39:0/2617555448 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52d873640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb528071620 0x7fb5280b3490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb52400e9b0 tx=0x7fb52400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== osd.4 v2:172.21.15.102:6816/3161248300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f377800be50 con 0x7f3760078610 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae58bfe640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae54070400 0x7fae540ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 -- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae54070400 msgr2=0x7fae540ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fae54070400 0x7fae540ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 -- 172.21.15.39:0/3950526402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae54145040 msgr2=0x7fae541ec360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae54145040 0x7fae541ec360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 -- 172.21.15.39:0/3950526402 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae540ae950 con 0x7fae54074680 2024-09-13T11:12:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f71fb7fe640 1 --2- 172.21.15.39:0/2476879434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 0x7f71f40347e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71fc069dd0 tx=0x7f71fc098640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=768d426d8dd4fe00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56840abaf0 0x7f5684148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000072d0 con 0x7f35f40051d0 2024-09-13T11:12:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524017070 con 0x7fb528071620 2024-09-13T11:12:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb52400c9a0 con 0x7fb528071620 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5280b4530 con 0x7fb528071620 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5d8659c640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5d68072100 0x7f5d680745c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0b1000 tx=0x7f5d7c0a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3600007470 con 0x7f35f40051d0 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3604168400 con 0x7f35f40051d0 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36040cd0c0 con 0x7f35f40051d0 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000047f0 con 0x7f35f40051d0 2024-09-13T11:12:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f35f1ffb640 1 -- 172.21.15.39:0/97988523 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36040cc0b0 con 0x7f35f40051d0 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- start start 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264003c40 0x7f927c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f927c131f40 0x7f927c132380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f927c1328c0 0x7f927c12ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f927c070930 con 0x7f9264003c40 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f927c0707b0 con 0x7f927c131f40 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f928093a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f927c14bcc0 con 0x7f927c1328c0 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264003c40 0x7f927c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264003c40 0x7f927c147c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53050/0 (socket says 172.21.15.39:53050) 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 -- 172.21.15.39:0/3796630383 learned_addr learned my addr 172.21.15.39:0/3796630383 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927affd640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f927c131f40 0x7f927c132380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 -- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f927c1328c0 msgr2=0x7f927c12ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f927c1328c0 0x7f927c12ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 -- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f927c131f40 msgr2=0x7f927c132380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f927c131f40 0x7f927c132380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927b7fe640 1 -- 172.21.15.39:0/3796630383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f927c0aaaf0 con 0x7f9264003c40 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f927affd640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f927c131f40 0x7f927c132380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52400cd70 con 0x7fb528071620 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52808ad60 con 0x7fb528071620 2024-09-13T11:12:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7fae53fff640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54074680 0x7fae541ebe20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae4800ca70 tx=0x7fae4800cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 -- 172.21.15.39:0/2617555448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5684148fd0 msgr2=0x7f568413d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5684148fd0 0x7f568413d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 -- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56841450f0 msgr2=0x7f56840ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56841450f0 0x7f56840ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 -- 172.21.15.39:0/2617555448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840ad540 con 0x7f56840abaf0 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.755+0000 7f5681d9b640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56840abaf0 0x7f5684148a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f567800d5a0 tx=0x7f567800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f927b7fe640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264003c40 0x7f927c147c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f926c01d390 tx=0x7f9264005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c007a20 con 0x7f9264003c40 2024-09-13T11:12:00.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c005480 con 0x7f9264003c40 2024-09-13T11:12:00.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c001550 con 0x7f9264003c40 2024-09-13T11:12:00.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f927c0ab320 con 0x7f9264003c40 2024-09-13T11:12:00.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f927c0ab040 con 0x7f9264003c40 2024-09-13T11:12:00.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f5d86d9d640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f5d68078540 0x7f5d6807a980 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678005bb0 con 0x7f56840abaf0 2024-09-13T11:12:00.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678018070 con 0x7f56840abaf0 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb528150080 con 0x7fb528071620 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== osd.3 v2:172.21.15.39:6800/2999541781 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5d6807b050 con 0x7f5d68078540 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f71faffd640 1 -- 172.21.15.39:0/2476879434 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc1264b0 con 0x7f71f402fa00 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f71faffd640 1 -- 172.21.15.39:0/2476879434 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71fc126690 con 0x7f71f402fa00 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f71faffd640 1 -- 172.21.15.39:0/2476879434 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc126b00 con 0x7f71f402fa00 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 -- 172.21.15.39:0/2476879434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 msgr2=0x7f71f40347e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 --2- 172.21.15.39:0/2476879434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 0x7f71f40347e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f71fc069dd0 tx=0x7f71fc098640 comp rx=0 tx=0).stop 2024-09-13T11:12:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f927c144770 con 0x7f9264003c40 2024-09-13T11:12:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 -- 172.21.15.39:0/2476879434 shutdown_connections 2024-09-13T11:12:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 --2- 172.21.15.39:0/2476879434 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402fa00 0x7f71f40347e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 --2- 172.21.15.39:0/2476879434 >> v2:172.21.15.102:3300/0 conn(0x7f71f40071d0 0x7f71f40311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 -- 172.21.15.39:0/2476879434 >> 172.21.15.39:0/2476879434 conn(0x7f71f4006080 msgr2=0x7f71f4006490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 -- 172.21.15.39:0/2476879434 shutdown_connections 2024-09-13T11:12:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678006050 con 0x7f56840abaf0 2024-09-13T11:12:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56840ad7b0 con 0x7f56840abaf0 2024-09-13T11:12:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56840ac4a0 con 0x7f56840abaf0 2024-09-13T11:12:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56840aaa30 con 0x7f56840abaf0 2024-09-13T11:12:00.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 -- 172.21.15.39:0/2476879434 wait complete. 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f3600011070 con 0x7f35f40051d0 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f35f3fff640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f35f80721d0 0x7f35f8074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f3600092b00 con 0x7f35f40051d0 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f35f3fff640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f35f8078610 0x7f35f807aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 --> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f360000de50 con 0x7f35f8078610 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fb52401a070 con 0x7fb528071620 2024-09-13T11:12:00.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7fb51e7fc640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb50c072150 0x7fb50c074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f360a7fc640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f35f80721d0 0x7f35f8074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f72029ce640 1 Processor -- start 2024-09-13T11:12:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48005cf0 con 0x7fae54074680 2024-09-13T11:12:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5414c7b0 con 0x7fae54074680 2024-09-13T11:12:00.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae48007070 con 0x7fae54074680 2024-09-13T11:12:00.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.759+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f5678004020 con 0x7f56840abaf0 2024-09-13T11:12:00.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f5672ffd640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f56640721d0 0x7f5664074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f5678093290 con 0x7f56840abaf0 2024-09-13T11:12:00.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f5672ffd640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f5664078610 0x7f566407aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 --> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5678001d40 con 0x7f5664078610 2024-09-13T11:12:00.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5678093680 con 0x7f56840abaf0 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 -- start start 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40071d0 0x7f71f40cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402ed10 0x7f71f40cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f402fa00 0x7f71f4029140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40d9290 con 0x7f71f402fa00 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71f40d9110 con 0x7f71f40071d0 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f72029ce640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f71f40d9410 con 0x7f71f402ed10 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f7200f6b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f402fa00 0x7f71f4029140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f926c0067e0 con 0x7f9264003c40 2024-09-13T11:12:00.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9268072150 0x7f9268074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f926c12f1f0 con 0x7f9264003c40 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f9268078590 0x7f926807a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 --> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f926c0052d0 con 0x7f9268078590 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f926c12f6d0 con 0x7f9264003c40 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f927bfff640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f9268078590 0x7f926807a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f7200f6b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f402fa00 0x7f71f4029140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53066/0 (socket says 172.21.15.39:53066) 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f7200f6b640 1 -- 172.21.15.39:0/2597957681 learned_addr learned my addr 172.21.15.39:0/2597957681 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:00.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40071d0 0x7f71f40cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f927bfff640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f9268078590 0x7f926807a9d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f927affd640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9268072150 0x7f9268074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 -- 172.21.15.39:0/2597957681 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402ed10 msgr2=0x7f71f40cdd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71f402ed10 0x7f71f40cdd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 -- 172.21.15.39:0/2597957681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f402fa00 msgr2=0x7f71f4029140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71f402fa00 0x7f71f4029140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 -- 172.21.15.39:0/2597957681 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f40cf1b0 con 0x7f71f40071d0 2024-09-13T11:12:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48007440 con 0x7fae54074680 2024-09-13T11:12:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae540ad940 con 0x7fae54074680 2024-09-13T11:12:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae540707e0 con 0x7fae54074680 2024-09-13T11:12:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fae480075e0 con 0x7fae54074680 2024-09-13T11:12:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f5682d9d640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f5664078610 0x7f566407aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fae40072180 0x7fae40074640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f360a7fc640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f35f80721d0 0x7f35f8074690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3604029e40 tx=0x7f35fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fae4809b3a0 con 0x7fae54074680 2024-09-13T11:12:00.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== osd.1 v2:172.21.15.39:6816/3509723286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f926c0052d0 con 0x7f9268078590 2024-09-13T11:12:00.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fae400785c0 0x7fae4007aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae48007070 con 0x7fae400785c0 2024-09-13T11:12:00.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fae48097060 con 0x7fae54074680 2024-09-13T11:12:00.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71fbfff640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40071d0 0x7f71f40cd240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b410 tx=0x7f71ec00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae58bfe640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fae40072180 0x7fae40074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f360b7fe640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f35f8078610 0x7f35f807aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f927affd640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9268072150 0x7f9268074610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f927c0b06b0 tx=0x7f9270008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fae593ff640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fae400785c0 0x7fae4007aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7fb52d072640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb50c072150 0x7fb50c074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.763+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec015020 con 0x7f71f40071d0 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f360005a5c0 con 0x7f35f40051d0 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f360b7fe640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f35f8078610 0x7f35f807aa50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fb524059f10 con 0x7fb528071620 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb51e7fc640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fb50c078590 0x7fb50c07a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 --> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb52401ae70 con 0x7fb50c078590 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb52405a2f0 con 0x7fb528071620 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb52e074640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fb50c078590 0x7fb50c07a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb52d072640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb50c072150 0x7fb50c074610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5280b39d0 tx=0x7fb518009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb52e074640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fb50c078590 0x7fb50c07a9d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fae58bfe640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fae40072180 0x7fae40074640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0ae000 tx=0x7fae4c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec011850 con 0x7f71f40071d0 2024-09-13T11:12:00.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec011c40 con 0x7f71f40071d0 2024-09-13T11:12:00.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f40cef30 con 0x7f71f40071d0 2024-09-13T11:12:00.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f4029680 con 0x7f71f40071d0 2024-09-13T11:12:00.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71f40311f0 con 0x7f71f40071d0 2024-09-13T11:12:00.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f568259c640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f56640721d0 0x7f5664074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f5682d9d640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f5664078610 0x7f566407aa50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f568259c640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f56640721d0 0x7f5664074690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56740ad000 tx=0x7f5674004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fae593ff640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fae400785c0 0x7fae4007aa00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== osd.2 v2:172.21.15.39:6824/1540683038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb52401ae70 con 0x7fb50c078590 2024-09-13T11:12:00.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== osd.5 v2:172.21.15.102:6824/498174754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae48007070 con 0x7fae400785c0 2024-09-13T11:12:00.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.767+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f71ec018020 con 0x7f71f40071d0 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71f8ff9640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f71e80721d0 0x7f71e8074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f71ec092cf0 con 0x7f71f40071d0 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71fb7fe640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f71e80721d0 0x7f71e8074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71f8ff9640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f71e8078610 0x7f71e807aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 --> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71e807b120 con 0x7f71e8078610 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f71ec0930e0 con 0x7f71f40071d0 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f71fb7fe640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f71e80721d0 0x7f71e8074690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71f4032f70 tx=0x7f71fc070040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.771+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== osd.0 v2:172.21.15.39:6808/1555151115 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f360000de50 con 0x7f35f8078610 2024-09-13T11:12:00.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.775+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== osd.7 v2:172.21.15.102:6800/3217028379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5678001d40 con 0x7f5664078610 2024-09-13T11:12:00.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 --> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5d800ce8a0 con 0x7f5d68078540 2024-09-13T11:12:00.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f7200f6b640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f71e8078610 0x7f71e807aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:00.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d76ffd640 1 -- 172.21.15.39:0/2326697950 <== osd.3 v2:172.21.15.39:6800/2999541781 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5d800ce8a0 con 0x7f5d68078540 2024-09-13T11:12:00.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f7200f6b640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f71e8078610 0x7f71e807aa50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:00.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f5d68078540 msgr2=0x7f5d6807a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f5d68078540 0x7f5d6807a980 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5d68072100 msgr2=0x7f5d680745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5d68072100 0x7f5d680745c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0b1000 tx=0x7f5d7c0a9070 comp rx=0 tx=0).stop 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800c4300 msgr2=0x7f5d800ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d8759e640 1 --2- 172.21.15.39:0/2326697950 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5d800c4300 0x7f5d800ce300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c8b0 tx=0x7f5d7800cd70 comp rx=0 tx=0).stop 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f5d86d9d640 1 -- 172.21.15.39:0/2326697950 reap_dead start 2024-09-13T11:12:00.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.779+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== osd.6 v2:172.21.15.102:6808/2547475669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71e807b120 con 0x7f71e8078610 2024-09-13T11:12:00.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.783+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 shutdown_connections 2024-09-13T11:12:00.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.783+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 >> 172.21.15.39:0/2326697950 conn(0x7f5d80005c30 msgr2=0x7f5d800c1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.783+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 shutdown_connections 2024-09-13T11:12:00.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.783+0000 7f5d8759e640 1 -- 172.21.15.39:0/2326697950 wait complete. 2024-09-13T11:12:00.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.783+0000 7f3784ab6640 1 -- 172.21.15.39:0/2567379519 --> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37801395d0 con 0x7f3760078610 2024-09-13T11:12:00.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.787+0000 7f376effd640 1 -- 172.21.15.39:0/2567379519 <== osd.4 v2:172.21.15.102:6816/3161248300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f37801395d0 con 0x7f3760078610 2024-09-13T11:12:00.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 --> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5280b4240 con 0x7fb50c078590 2024-09-13T11:12:00.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb51e7fc640 1 -- 172.21.15.39:0/455359503 <== osd.2 v2:172.21.15.39:6824/1540683038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5280b4240 con 0x7fb50c078590 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fb50c078590 msgr2=0x7fb50c07a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fb50c078590 0x7fb50c07a9d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb50c072150 msgr2=0x7fb50c074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb50c072150 0x7fb50c074610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5280b39d0 tx=0x7fb518009040 comp rx=0 tx=0).stop 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb528071620 msgr2=0x7fb5280b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 --2- 172.21.15.39:0/455359503 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb528071620 0x7fb5280b3490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb52400e9b0 tx=0x7fb52400ee70 comp rx=0 tx=0).stop 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52e074640 1 -- 172.21.15.39:0/455359503 reap_dead start 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 shutdown_connections 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 >> 172.21.15.39:0/455359503 conn(0x7fb5280b4eb0 msgr2=0x7fb5280b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 shutdown_connections 2024-09-13T11:12:00.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7fb52fad7640 1 -- 172.21.15.39:0/455359503 wait complete. 2024-09-13T11:12:00.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 --> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f927c06fcd0 con 0x7f9268078590 2024-09-13T11:12:00.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7f9263fff640 1 -- 172.21.15.39:0/3796630383 <== osd.1 v2:172.21.15.39:6816/3509723286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f927c06fcd0 con 0x7f9268078590 2024-09-13T11:12:00.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f3760078610 msgr2=0x7f376007aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.791+0000 7f376cff9640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f3760078610 0x7f376007aa50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f37600721d0 msgr2=0x7f3760074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f37600721d0 0x7f3760074690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f377400a790 tx=0x7f3774005c30 comp rx=0 tx=0).stop 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f378013caa0 msgr2=0x7f3780138b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 --2- 172.21.15.39:0/2567379519 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f378013caa0 0x7f3780138b50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3778007d40 tx=0x7f377800e4b0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f377ed9d640 1 -- 172.21.15.39:0/2567379519 reap_dead start 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 shutdown_connections 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 >> 172.21.15.39:0/2567379519 conn(0x7f37800b4eb0 msgr2=0x7f378013f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 shutdown_connections 2024-09-13T11:12:00.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f376cff9640 1 -- 172.21.15.39:0/2567379519 wait complete. 2024-09-13T11:12:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f9268078590 msgr2=0x7f926807a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f9268078590 0x7f926807a9d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9268072150 msgr2=0x7f9268074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9268072150 0x7f9268074610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f927c0b06b0 tx=0x7f9270008040 comp rx=0 tx=0).stop 2024-09-13T11:12:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264003c40 msgr2=0x7f927c147c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 --2- 172.21.15.39:0/3796630383 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9264003c40 0x7f927c147c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f926c01d390 tx=0x7f9264005840 comp rx=0 tx=0).stop 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f927bfff640 1 -- 172.21.15.39:0/3796630383 reap_dead start 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 shutdown_connections 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 >> 172.21.15.39:0/3796630383 conn(0x7f927c0b4d40 msgr2=0x7f927c1435a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 shutdown_connections 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7f928093a640 1 -- 172.21.15.39:0/3796630383 wait complete. 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.795+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae54070ff0 con 0x7fae400785c0 2024-09-13T11:12:00.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f35f1ffb640 1 -- 172.21.15.39:0/97988523 --> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f36040d0760 con 0x7f35f8078610 2024-09-13T11:12:00.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae517fa640 1 -- 172.21.15.39:0/3950526402 <== osd.5 v2:172.21.15.102:6824/498174754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae54070ff0 con 0x7fae400785c0 2024-09-13T11:12:00.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f35f3fff640 1 -- 172.21.15.39:0/97988523 <== osd.0 v2:172.21.15.39:6808/1555151115 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f36040d0760 con 0x7f35f8078610 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f35f8078610 msgr2=0x7f35f807aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f35f8078610 0x7f35f807aa50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f35f80721d0 msgr2=0x7f35f8074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f35f80721d0 0x7f35f8074690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3604029e40 tx=0x7f35fc008040 comp rx=0 tx=0).stop 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 msgr2=0x7f360402aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 --2- 172.21.15.39:0/97988523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f35f40051d0 0x7f360402aaf0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f360000c760 tx=0x7f360000cc20 comp rx=0 tx=0).stop 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f360b7fe640 1 -- 172.21.15.39:0/97988523 reap_dead start 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 shutdown_connections 2024-09-13T11:12:00.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 >> 172.21.15.39:0/97988523 conn(0x7f3604005c60 msgr2=0x7f36040c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 shutdown_connections 2024-09-13T11:12:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fae400785c0 msgr2=0x7fae4007aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fae400785c0 0x7fae4007aa00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7f361192f640 1 -- 172.21.15.39:0/97988523 wait complete. 2024-09-13T11:12:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fae40072180 msgr2=0x7fae40074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fae40072180 0x7fae40074640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0ae000 tx=0x7fae4c0a7000 comp rx=0 tx=0).stop 2024-09-13T11:12:00.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54074680 msgr2=0x7fae541ebe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 --2- 172.21.15.39:0/3950526402 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fae54074680 0x7fae541ebe20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fae4800ca70 tx=0x7fae4800cf30 comp rx=0 tx=0).stop 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae593ff640 1 -- 172.21.15.39:0/3950526402 reap_dead start 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 shutdown_connections 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 >> 172.21.15.39:0/3950526402 conn(0x7fae540b5140 msgr2=0x7fae540b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 shutdown_connections 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.799+0000 7fae5ae62640 1 -- 172.21.15.39:0/3950526402 wait complete. 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.803+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 --> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f56840aaa30 con 0x7f5664078610 2024-09-13T11:12:00.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.803+0000 7f5672ffd640 1 -- 172.21.15.39:0/2617555448 <== osd.7 v2:172.21.15.102:6800/3217028379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f567c009cb0 con 0x7f5664078610 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f5664078610 msgr2=0x7f566407aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f5664078610 0x7f566407aa50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f56640721d0 msgr2=0x7f5664074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f56640721d0 0x7f5664074690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f56740ad000 tx=0x7f5674004740 comp rx=0 tx=0).stop 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56840abaf0 msgr2=0x7f5684148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 --2- 172.21.15.39:0/2617555448 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f56840abaf0 0x7f5684148a90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f567800d5a0 tx=0x7f567800da60 comp rx=0 tx=0).stop 2024-09-13T11:12:00.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f5682d9d640 1 -- 172.21.15.39:0/2617555448 reap_dead start 2024-09-13T11:12:00.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 --> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71f40ccd90 con 0x7f71e8078610 2024-09-13T11:12:00.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 shutdown_connections 2024-09-13T11:12:00.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 >> 172.21.15.39:0/2617555448 conn(0x7f56840b2f50 msgr2=0x7f568406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.841 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-09-13T11:12:00.841 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T11:12:00.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 shutdown_connections 2024-09-13T11:12:00.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f568892e640 1 -- 172.21.15.39:0/2617555448 wait complete. 2024-09-13T11:12:00.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.807+0000 7f71f8ff9640 1 -- 172.21.15.39:0/2597957681 <== osd.6 v2:172.21.15.102:6808/2547475669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f71f40ccd90 con 0x7f71e8078610 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f71e8078610 msgr2=0x7f71e807aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f71e8078610 0x7f71e807aa50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f71e80721d0 msgr2=0x7f71e8074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f71e80721d0 0x7f71e8074690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71f4032f70 tx=0x7f71fc070040 comp rx=0 tx=0).stop 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40071d0 msgr2=0x7f71f40cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 --2- 172.21.15.39:0/2597957681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71f40071d0 0x7f71f40cd240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00b410 tx=0x7f71ec00b8d0 comp rx=0 tx=0).stop 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f7200f6b640 1 -- 172.21.15.39:0/2597957681 reap_dead start 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 shutdown_connections 2024-09-13T11:12:00.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 >> 172.21.15.39:0/2597957681 conn(0x7f71f4006080 msgr2=0x7f71f4037fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 shutdown_connections 2024-09-13T11:12:00.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:00.811+0000 7f72029ce640 1 -- 172.21.15.39:0/2597957681 wait complete. 2024-09-13T11:12:00.844 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-13T11:12:00.844 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T11:12:00.845 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:00.845 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T11:12:00.846 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-13T11:12:00.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T11:12:00.847 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-09-13T11:12:00.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T11:12:00.848 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-09-13T11:12:00.848 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T11:12:00.849 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:00.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T11:12:00.850 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:00.850 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T11:12:01.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 Processor -- start 2024-09-13T11:12:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 -- start start 2024-09-13T11:12:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb268036f00 0x7fb26802fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2680303e0 0x7fb268032230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb268033e70 con 0x7fb268032770 2024-09-13T11:12:01.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb2680372e0 con 0x7fb268036f00 2024-09-13T11:12:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb276a0f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fb26802d2f0 con 0x7fb2680303e0 2024-09-13T11:12:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fa4af511640 1 Processor -- start 2024-09-13T11:12:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb27620e640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb268032770 0x7fb2680354a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39548/0 (socket says 172.21.15.39:39548) 2024-09-13T11:12:01.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb27620e640 1 -- 172.21.15.39:0/2513463414 learned_addr learned my addr 172.21.15.39:0/2513463414 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7f7123595640 1 Processor -- start 2024-09-13T11:12:01.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb275a0d640 1 --2- 172.21.15.39:0/2513463414 >> v2:172.21.15.102:3300/0 conn(0x7fb268036f00 0x7fb26802fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb27520c640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2680303e0 0x7fb268032230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7f8169f21640 1 Processor -- start 2024-09-13T11:12:01.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7f8169f21640 1 -- start start 2024-09-13T11:12:01.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fa4af511640 1 -- start start 2024-09-13T11:12:01.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb274a0b640 1 -- 172.21.15.39:0/2513463414 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904057007 0 0) 0x7fb268033e70 con 0x7fb268032770 2024-09-13T11:12:01.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7fb274a0b640 1 -- 172.21.15.39:0/2513463414 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb25c003530 con 0x7fb268032770 2024-09-13T11:12:01.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffad83640 1 Processor -- start 2024-09-13T11:12:01.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7f7123595640 1 -- start start 2024-09-13T11:12:01.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4af511640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a81437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4af511640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa4a813cca0 0x7fa4a813d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4af511640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4a80aa4c0 0x7fa4a80aa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4af511640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a80b9cd0 con 0x7fa4a813cca0 2024-09-13T11:12:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4af511640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a8143fe0 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4af511640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a8143d20 con 0x7fa4a80b98f0 2024-09-13T11:12:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb275a0d640 1 -- 172.21.15.39:0/2513463414 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2680303e0 msgr2=0x7fb268032230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb275a0d640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2680303e0 0x7fb268032230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb275a0d640 1 -- 172.21.15.39:0/2513463414 >> v1:172.21.15.39:6789/0 conn(0x7fb268032770 legacy=0x7fb2680354a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb275a0d640 1 -- 172.21.15.39:0/2513463414 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2680c1bc0 con 0x7fb268036f00 2024-09-13T11:12:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb27520c640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2680303e0 0x7fb268032230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:01.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efdea01d640 1 Processor -- start 2024-09-13T11:12:01.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7123595640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140345f0 0x7f71140c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7123595640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7114032c20 con 0x7f71140c4300 2024-09-13T11:12:01.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7123595640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711402c710 con 0x7f71140cbd50 2024-09-13T11:12:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7123595640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f71140349d0 con 0x7f71140345f0 2024-09-13T11:12:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7121d92640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f71140c4300 0x7f71140317c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39560/0 (socket says 172.21.15.39:39560) 2024-09-13T11:12:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7121d92640 1 -- 172.21.15.39:0/1917394789 learned_addr learned my addr 172.21.15.39:0/1917394789 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4a80aa4c0 0x7fa4a80aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4a80aa4c0 0x7fa4a80aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:59020/0 (socket says 172.21.15.39:59020) 2024-09-13T11:12:01.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 -- 172.21.15.39:0/4293325793 learned_addr learned my addr 172.21.15.39:0/4293325793 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7122593640 1 --2- 172.21.15.39:0/1917394789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140345f0 0x7f71140c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7feafab8b640 1 Processor -- start 2024-09-13T11:12:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.059+0000 7feafab8b640 1 -- start start 2024-09-13T11:12:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafab8b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feaf40703f0 0x7feaf41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafab8b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40726c0 con 0x7feaf40707d0 2024-09-13T11:12:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafab8b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40729a0 con 0x7feaf4144320 2024-09-13T11:12:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafab8b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feaf40718a0 con 0x7feaf40703f0 2024-09-13T11:12:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf9388640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7feaf40707d0 0x7feaf4147e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39558/0 (socket says 172.21.15.39:39558) 2024-09-13T11:12:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf9388640 1 -- 172.21.15.39:0/1703274460 learned_addr learned my addr 172.21.15.39:0/1703274460 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723404668 0 0) 0x7feaf40726c0 con 0x7feaf40707d0 2024-09-13T11:12:01.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feadc003530 con 0x7feaf40707d0 2024-09-13T11:12:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4acaac640 1 --2- 172.21.15.39:0/4293325793 >> v2:172.21.15.39:3300/0 conn(0x7fa4a813cca0 0x7fa4a813d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffad83640 1 -- start start 2024-09-13T11:12:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffad83640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff4070d30 0x7f5ff4147c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffad83640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff4071470 con 0x7f5ff4074290 2024-09-13T11:12:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffad83640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff40af890 con 0x7f5ff40b2610 2024-09-13T11:12:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffad83640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff40b29f0 con 0x7f5ff4070d30 2024-09-13T11:12:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffa582640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f5ff4074290 0x7f5ff4151fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39566/0 (socket says 172.21.15.39:39566) 2024-09-13T11:12:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffa582640 1 -- 172.21.15.39:0/2186882107 learned_addr learned my addr 172.21.15.39:0/2186882107 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169f21640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c006eb0 0x7f815c033120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169f21640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f815c035e70 0x7f815c0d1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169f21640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815c034a90 con 0x7f815c033660 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169f21640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f815c036d90 con 0x7f815c035e70 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169f21640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f815c033a80 con 0x7f815c006eb0 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f815c035e70 0x7f815c0d1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f815c035e70 0x7f815c0d1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:59034/0 (socket says 172.21.15.39:59034) 2024-09-13T11:12:01.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 -- 172.21.15.39:0/1312863120 learned_addr learned my addr 172.21.15.39:0/1312863120 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8168f1f640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c006eb0 0x7f815c033120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 -- 172.21.15.39:0/1312863120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c006eb0 msgr2=0x7f815c033120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c006eb0 0x7f815c033120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 -- 172.21.15.39:0/1312863120 >> v1:172.21.15.39:6789/0 conn(0x7f815c033660 legacy=0x7f815c035760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8169720640 1 -- 172.21.15.39:0/1312863120 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c036fc0 con 0x7f815c035e70 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f8168f1f640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c006eb0 0x7f815c033120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:01.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163372079 0 0) 0x7f5ff4071470 con 0x7f5ff4074290 2024-09-13T11:12:01.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe0003530 con 0x7f5ff4074290 2024-09-13T11:12:01.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff9580640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff4070d30 0x7f5ff4147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2887247325 0 0) 0x7f5fe0003530 con 0x7f5ff4074290 2024-09-13T11:12:01.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 -- 172.21.15.39:0/4293325793 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 msgr2=0x7fa4a81437e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:12:01.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 --2- 172.21.15.39:0/4293325793 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a81437e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 -- 172.21.15.39:0/4293325793 >> v2:172.21.15.39:3300/0 conn(0x7fa4a813cca0 msgr2=0x7fa4a813d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 --2- 172.21.15.39:0/4293325793 >> v2:172.21.15.39:3300/0 conn(0x7fa4a813cca0 0x7fa4a813d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fa4adaae640 1 -- 172.21.15.39:0/4293325793 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80ac510 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efdea01d640 1 -- start start 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efdea01d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efde4070630 0x7efde4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efdea01d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde40749c0 con 0x7efde4071860 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efdea01d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde4072a60 con 0x7efde41429a0 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efdea01d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efde4073870 con 0x7efde4070630 2024-09-13T11:12:01.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efde2ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7efde4071860 0x7efde4073160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39568/0 (socket says 172.21.15.39:39568) 2024-09-13T11:12:01.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efde2ffd640 1 -- 172.21.15.39:0/2361012901 learned_addr learned my addr 172.21.15.39:0/2361012901 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:01.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efde3fff640 1 --2- 172.21.15.39:0/2361012901 >> v2:172.21.15.102:3300/0 conn(0x7efde4070630 0x7efde4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7122593640 1 -- 172.21.15.39:0/1917394789 >> v1:172.21.15.102:6789/0 conn(0x7f71140cbd50 legacy=0x7f71140ce140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:12:01.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7122593640 1 -- 172.21.15.39:0/1917394789 >> v1:172.21.15.39:6789/0 conn(0x7f71140c4300 legacy=0x7f71140317c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7121591640 1 -- 172.21.15.39:0/1917394789 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700417219 0 0) 0x7f7114032c20 con 0x7f71140c4300 2024-09-13T11:12:01.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f7122593640 1 -- 172.21.15.39:0/1917394789 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7114031220 con 0x7f71140345f0 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf9b89640 1 --2- 172.21.15.39:0/1703274460 >> v2:172.21.15.102:3300/0 conn(0x7feaf40703f0 0x7feaf41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086823451 0 0) 0x7feadc003530 con 0x7feaf40707d0 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 >> v2:172.21.15.102:3300/0 conn(0x7feaf40703f0 msgr2=0x7feaf41478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 --2- 172.21.15.39:0/1703274460 >> v2:172.21.15.102:3300/0 conn(0x7feaf40703f0 0x7feaf41478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 >> v1:172.21.15.102:6789/0 conn(0x7feaf4144320 legacy=0x7feaf4144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf4074780 con 0x7feaf40707d0 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7feaec001700 con 0x7feaf40707d0 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 >> v1:172.21.15.39:6789/0 conn(0x7feaf40707d0 legacy=0x7feaf4147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc003a10 0x7feadc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc004810 0x7feadc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feadc0051d0 0x7feadc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff4070d30 msgr2=0x7f5ff4147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf9388640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc004810 0x7feadc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40718a0 con 0x7feadc004810 2024-09-13T11:12:01.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feadc00c100 con 0x7feadc003a10 2024-09-13T11:12:01.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7feadc00c300 con 0x7feadc0051d0 2024-09-13T11:12:01.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafa38a640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feadc0051d0 0x7feadc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7efde27fc640 1 -- 172.21.15.39:0/2361012901 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460853839 0 0) 0x7efde40749c0 con 0x7efde4071860 2024-09-13T11:12:01.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb275a0d640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb268036f00 0x7fb26802fea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097c0 tx=0x7fb26c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38abcba14add3e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff4070d30 0x7f5ff4147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 >> v1:172.21.15.102:6789/0 conn(0x7f5ff40b2610 legacy=0x7f5ff4070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff4071710 con 0x7f5ff4074290 2024-09-13T11:12:01.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f5ff0001700 con 0x7f5ff4074290 2024-09-13T11:12:01.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 >> v1:172.21.15.39:6789/0 conn(0x7f5ff4074290 legacy=0x7f5ff4151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe0003a40 0x7f5fe0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5fe0004810 0x7f5fe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe00051d0 0x7f5fe000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000c0d0 con 0x7f5fe00051d0 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe000c280 con 0x7f5fe0003a40 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe000c480 con 0x7f5fe0004810 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ff9580640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff4070d30 0x7f5ff4147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7f5ffa582640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe00051d0 0x7f5fe000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feaf9b89640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc003a10 0x7feadc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafa38a640 1 -- 172.21.15.39:0/1703274460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc003a10 msgr2=0x7feadc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafa38a640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feadc003a10 0x7feadc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafa38a640 1 -- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc004810 msgr2=0x7feadc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafa38a640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc004810 0x7feadc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7feafa38a640 1 -- 172.21.15.39:0/1703274460 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf4074780 con 0x7feadc0051d0 2024-09-13T11:12:01.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7efde3fff640 1 -- 172.21.15.39:0/2361012901 >> v1:172.21.15.102:6789/0 conn(0x7efde41429a0 legacy=0x7efde40742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7efde3fff640 1 -- 172.21.15.39:0/2361012901 >> v1:172.21.15.39:6789/0 conn(0x7efde4071860 legacy=0x7efde4073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ffa582640 1 -- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5fe0004810 msgr2=0x7f5fe0004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:12:01.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7efde3fff640 1 -- 172.21.15.39:0/2361012901 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde40739f0 con 0x7efde4070630 2024-09-13T11:12:01.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ff9580640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5fe0004810 0x7f5fe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb274a0b640 1 -- 172.21.15.39:0/2513463414 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0b0070 con 0x7fb268036f00 2024-09-13T11:12:01.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.063+0000 7fb274a0b640 1 -- 172.21.15.39:0/2513463414 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c0ab600 con 0x7fb268036f00 2024-09-13T11:12:01.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- 172.21.15.39:0/2513463414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb268036f00 msgr2=0x7fb26802fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb268036f00 0x7fb26802fea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097c0 tx=0x7fb26c01c3f0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ff9d81640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe0003a40 0x7f5fe0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- 172.21.15.39:0/2513463414 shutdown_connections 2024-09-13T11:12:01.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb2680303e0 0x7fb268032230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 --2- 172.21.15.39:0/2513463414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb268036f00 0x7fb26802fea0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0097c0 tx=0x7fb26c01c3f0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- 172.21.15.39:0/2513463414 >> 172.21.15.39:0/2513463414 conn(0x7fb26803a110 msgr2=0x7fb268036590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4adaae640 1 --2- 172.21.15.39:0/4293325793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80aa970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8143f50 tx=0x7fa4a001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b248b76e3ee55582 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- 172.21.15.39:0/2513463414 shutdown_connections 2024-09-13T11:12:01.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa49ffff640 1 -- 172.21.15.39:0/4293325793 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00a5850 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7122593640 1 --2- 172.21.15.39:0/1917394789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140345f0 0x7f71140c3dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f711800a990 tx=0x7f711801d770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=def21f78581b3782 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa49ffff640 1 -- 172.21.15.39:0/4293325793 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a00a59f0 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa49ffff640 1 -- 172.21.15.39:0/4293325793 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00a5dc0 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7121591640 1 -- 172.21.15.39:0/1917394789 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71180ad070 con 0x7f71140345f0 2024-09-13T11:12:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ffa582640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5fe0004810 0x7f5fe0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ffa582640 1 -- 172.21.15.39:0/2186882107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe0003a40 msgr2=0x7f5fe0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ffa582640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe0003a40 0x7f5fe0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ffa582640 1 -- 172.21.15.39:0/2186882107 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe0003530 con 0x7f5fe00051d0 2024-09-13T11:12:01.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f8169720640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c035e70 0x7f815c0d1c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8158009870 tx=0x7f815801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51c46c77264d310 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 -- 172.21.15.39:0/4293325793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a80aa4c0 msgr2=0x7fa4a80aa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- 172.21.15.39:0/2513463414 wait complete. 2024-09-13T11:12:01.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 Processor -- start 2024-09-13T11:12:01.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 --2- 172.21.15.39:0/4293325793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80aa970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8143f50 tx=0x7fa4a001c9f0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f5ff9d81640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe0003a40 0x7f5fe0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:01.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 -- 172.21.15.39:0/4293325793 shutdown_connections 2024-09-13T11:12:01.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f81637fe640 1 -- 172.21.15.39:0/1312863120 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580b0070 con 0x7f815c035e70 2024-09-13T11:12:01.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f81637fe640 1 -- 172.21.15.39:0/1312863120 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81580ab600 con 0x7f815c035e70 2024-09-13T11:12:01.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f81637fe640 1 -- 172.21.15.39:0/1312863120 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580ab9d0 con 0x7f815c035e70 2024-09-13T11:12:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 --2- 172.21.15.39:0/4293325793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80aa970 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7feafa38a640 1 -- 172.21.15.39:0/1703274460 reap_dead start 2024-09-13T11:12:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7121591640 1 -- 172.21.15.39:0/1917394789 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71180a7610 con 0x7f71140345f0 2024-09-13T11:12:01.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7121591640 1 -- 172.21.15.39:0/1917394789 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711800b040 con 0x7f71140345f0 2024-09-13T11:12:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 -- 172.21.15.39:0/1917394789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140345f0 msgr2=0x7f71140c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 --2- 172.21.15.39:0/1917394789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140345f0 0x7f71140c3dc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f711800a990 tx=0x7f711801d770 comp rx=0 tx=0).stop 2024-09-13T11:12:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 --2- 172.21.15.39:0/4293325793 >> v2:172.21.15.39:3300/0 conn(0x7fa4a813cca0 0x7fa4a813d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 --2- 172.21.15.39:0/4293325793 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a81437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 -- 172.21.15.39:0/4293325793 >> 172.21.15.39:0/4293325793 conn(0x7fa4a802d600 msgr2=0x7fa4a802da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7feafa38a640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feadc0051d0 0x7feadc00b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feae8003db0 tx=0x7feae801c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c582cbf50630aee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 -- 172.21.15.39:0/1917394789 shutdown_connections 2024-09-13T11:12:01.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 --2- 172.21.15.39:0/1917394789 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140345f0 0x7f71140c3dc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 -- 172.21.15.39:0/1917394789 >> 172.21.15.39:0/1917394789 conn(0x7f7114005c30 msgr2=0x7f7114006040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 -- 172.21.15.39:0/1917394789 shutdown_connections 2024-09-13T11:12:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 -- 172.21.15.39:0/4293325793 shutdown_connections 2024-09-13T11:12:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae80039b0 con 0x7feadc0051d0 2024-09-13T11:12:01.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fa4af511640 1 -- 172.21.15.39:0/4293325793 wait complete. 2024-09-13T11:12:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae80ab640 con 0x7feadc0051d0 2024-09-13T11:12:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f8169f21640 1 -- 172.21.15.39:0/1312863120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c035e70 msgr2=0x7f815c0d1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f8169f21640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c035e70 0x7f815c0d1c10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8158009870 tx=0x7f815801c4b0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- start start 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2680303e0 0x7fb26802c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 0x7fb2680c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2680c4350 0x7fb26815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb268006a10 con 0x7fb2680303e0 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb268006890 con 0x7fb2680c4350 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7fb276a0f640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fb268006b90 con 0x7fb268032770 2024-09-13T11:12:01.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.067+0000 7f7123595640 1 -- 172.21.15.39:0/1917394789 wait complete. 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- 172.21.15.39:0/1312863120 shutdown_connections 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c035e70 0x7f815c0d1c10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 --2- 172.21.15.39:0/1312863120 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c006eb0 0x7f815c033120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- 172.21.15.39:0/1312863120 >> 172.21.15.39:0/1312863120 conn(0x7f815c005d90 msgr2=0x7f815c0061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f5ff9580640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5fe0004810 0x7f5fe0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 0x7fb2680c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 0x7fb2680c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53304/0 (socket says 172.21.15.39:53304) 2024-09-13T11:12:01.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 -- 172.21.15.39:0/2635534225 learned_addr learned my addr 172.21.15.39:0/2635534225 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27620e640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2680c4350 0x7fb26815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feaf8b87640 1 -- 172.21.15.39:0/1703274460 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae80aba30 con 0x7feadc0051d0 2024-09-13T11:12:01.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- 172.21.15.39:0/1312863120 shutdown_connections 2024-09-13T11:12:01.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feadc0051d0 msgr2=0x7feadc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feadc0051d0 0x7feadc00b9d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feae8003db0 tx=0x7feae801c300 comp rx=0 tx=0).stop 2024-09-13T11:12:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- 172.21.15.39:0/1703274460 shutdown_connections 2024-09-13T11:12:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 --2- 172.21.15.39:0/1703274460 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feadc0051d0 0x7feadc00b9d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- 172.21.15.39:0/1703274460 >> 172.21.15.39:0/1703274460 conn(0x7feaf40b4d40 msgr2=0x7feaf40b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efde3fff640 1 --2- 172.21.15.39:0/2361012901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4070630 0x7efde4142d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efdd80097c0 tx=0x7efdd801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8616f35a812bfcbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- 172.21.15.39:0/1312863120 wait complete. 2024-09-13T11:12:01.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 -- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2680c4350 msgr2=0x7fb26815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2680c4350 0x7fb26815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 -- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2680303e0 msgr2=0x7fb26802c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2680303e0 0x7fb26802c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 -- 172.21.15.39:0/2635534225 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2680c0bd0 con 0x7fb268032770 2024-09-13T11:12:01.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 Processor -- start 2024-09-13T11:12:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- 172.21.15.39:0/1703274460 shutdown_connections 2024-09-13T11:12:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efde27fc640 1 -- 172.21.15.39:0/2361012901 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd80ab610 con 0x7efde4070630 2024-09-13T11:12:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efde27fc640 1 -- 172.21.15.39:0/2361012901 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd80b0070 con 0x7efde4070630 2024-09-13T11:12:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efde27fc640 1 -- 172.21.15.39:0/2361012901 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd80ab9d0 con 0x7efde4070630 2024-09-13T11:12:01.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 -- start start 2024-09-13T11:12:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 Processor -- start 2024-09-13T11:12:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 -- start start 2024-09-13T11:12:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 Processor -- start 2024-09-13T11:12:01.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- 172.21.15.39:0/1703274460 wait complete. 2024-09-13T11:12:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efdea01d640 1 -- 172.21.15.39:0/2361012901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4070630 msgr2=0x7efde4142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efdea01d640 1 --2- 172.21.15.39:0/2361012901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4070630 0x7efde4142d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efdd80097c0 tx=0x7efdd801c3f0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 0x7f71140c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71140c4300 0x7f7114167c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140cbd50 0x7f711402ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7114032050 con 0x7f71140345f0 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7114031ed0 con 0x7f71140c4300 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7123595640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f71140d2490 con 0x7f71140cbd50 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb27520c640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 0x7fb2680c3e10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb26000d630 tx=0x7fb26000daf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26000c7b0 con 0x7fb268032770 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb276a0f640 1 -- 172.21.15.39:0/2635534225 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2680c47d0 con 0x7fb268032770 2024-09-13T11:12:01.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb276a0f640 1 -- 172.21.15.39:0/2635534225 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2680bdcf0 con 0x7fb268032770 2024-09-13T11:12:01.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26000b620 con 0x7fb268032770 2024-09-13T11:12:01.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26000c7b0 con 0x7fb268032770 2024-09-13T11:12:01.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f5ffa582640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe00051d0 0x7f5fe000b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c190 tx=0x7f5ff001f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7519c9ce8bbac18d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 0x7f71140c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 0x7f71140c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53112/0 (socket says 172.21.15.39:53112) 2024-09-13T11:12:01.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 -- 172.21.15.39:0/3782512264 learned_addr learned my addr 172.21.15.39:0/3782512264 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- start start 2024-09-13T11:12:01.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 Processor -- start 2024-09-13T11:12:01.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efdea01d640 1 -- 172.21.15.39:0/2361012901 shutdown_connections 2024-09-13T11:12:01.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efdea01d640 1 --2- 172.21.15.39:0/2361012901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4070630 0x7efde4142d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efdea01d640 1 -- 172.21.15.39:0/2361012901 >> 172.21.15.39:0/2361012901 conn(0x7efde40b4d40 msgr2=0x7efde40b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7121d92640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71140c4300 0x7f7114167c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122d94640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140cbd50 0x7f711402ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- start start 2024-09-13T11:12:01.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0007cd0 con 0x7f5fe00051d0 2024-09-13T11:12:01.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0005ae0 con 0x7f5fe00051d0 2024-09-13T11:12:01.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f5ff8d7f640 1 -- 172.21.15.39:0/2186882107 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0007070 con 0x7f5fe00051d0 2024-09-13T11:12:01.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 -- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140cbd50 msgr2=0x7f711402ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140cbd50 0x7f711402ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 -- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71140c4300 msgr2=0x7f7114167c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71140c4300 0x7f7114167c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 -- 172.21.15.39:0/3782512264 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7114030800 con 0x7f71140345f0 2024-09-13T11:12:01.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4ad2ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4ad2ad640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53120/0 (socket says 172.21.15.39:53120) 2024-09-13T11:12:01.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4ad2ad640 1 -- 172.21.15.39:0/3953937376 learned_addr learned my addr 172.21.15.39:0/3953937376 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a813ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a813cca0 0x7fa4a813f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c006eb0 0x7f815c0ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 0x7f815c15f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c035e70 0x7f815c15fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0d4af0 con 0x7f815c035e70 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0d4970 con 0x7f815c006eb0 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f8169f21640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f815c0d4c70 con 0x7f815c033660 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4acaac640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a813ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8147530 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81473b0 con 0x7fa4a813cca0 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a81476b0 con 0x7fa4a80b98f0 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7f7122593640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 0x7f71140c6730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f711801be20 tx=0x7f711801a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 0x7feaf413f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feaf4143120 0x7feaf41466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4141750 0x7feaf4137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feaf4144b20 con 0x7feadc0051d0 2024-09-13T11:12:01.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feaf41449a0 con 0x7feaf4141750 2024-09-13T11:12:01.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7feafab8b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7feaf4144ca0 con 0x7feaf4143120 2024-09-13T11:12:01.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.071+0000 7efdea01d640 1 -- 172.21.15.39:0/2361012901 shutdown_connections 2024-09-13T11:12:01.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 -- 172.21.15.39:0/2361012901 wait complete. 2024-09-13T11:12:01.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 0x7f815c15f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 0x7f815c15f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53326/0 (socket says 172.21.15.39:53326) 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 -- 172.21.15.39:0/541046999 learned_addr learned my addr 172.21.15.39:0/541046999 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8168f1f640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c006eb0 0x7f815c0ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8169720640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c035e70 0x7f815c15fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffad83640 1 -- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe00051d0 msgr2=0x7f5fe000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffad83640 1 --2- 172.21.15.39:0/2186882107 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5fe00051d0 0x7f5fe000b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c190 tx=0x7f5ff001f2d0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffa582640 1 -- 172.21.15.39:0/2186882107 reap_dead start 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 0x7feaf413f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 0x7feaf413f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53126/0 (socket says 172.21.15.39:53126) 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 -- 172.21.15.39:0/1230436961 learned_addr learned my addr 172.21.15.39:0/1230436961 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feafa38a640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4141750 0x7feaf4137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 -- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c006eb0 msgr2=0x7f815c0ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c006eb0 0x7f815c0ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 -- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c035e70 msgr2=0x7f815c15fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c035e70 0x7f815c15fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 -- 172.21.15.39:0/541046999 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c0cd510 con 0x7f815c033660 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4ad2ad640 1 -- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 msgr2=0x7fa4a813ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4ad2ad640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a813ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4ad2ad640 1 -- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a813cca0 msgr2=0x7fa4a813f860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4ad2ad640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a813cca0 0x7fa4a813f860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4ad2ad640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a81dcdf0 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4ad2ad640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80b7f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b4a0 tx=0x7fa49800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71180ad040 con 0x7f71140345f0 2024-09-13T11:12:01.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71180ba070 con 0x7f71140345f0 2024-09-13T11:12:01.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8163fff640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 0x7f815c15f6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f815000c410 tx=0x7f815000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffad83640 1 -- 172.21.15.39:0/2186882107 shutdown_connections 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffad83640 1 -- 172.21.15.39:0/2186882107 >> 172.21.15.39:0/2186882107 conn(0x7f5ff40b57a0 msgr2=0x7f5ff40b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49801a920 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa49801f070 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49801ad20 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a8148640 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a813fda0 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 Processor -- start 2024-09-13T11:12:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fb26000c950 con 0x7fb268032770 2024-09-13T11:12:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fb2667fc640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb254072500 0x7fb2540749c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9388640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feaf4143120 0x7feaf41466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 -- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feaf4143120 msgr2=0x7feaf41466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feaf4143120 0x7feaf41466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 -- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4141750 msgr2=0x7feaf4137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4141750 0x7feaf4137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 -- 172.21.15.39:0/1230436961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf4142a20 con 0x7feadc0051d0 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feafa38a640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4141750 0x7feaf4137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf9b89640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 0x7feaf413f760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feae4009f90 tx=0x7feae400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fb26000c5b0 con 0x7fb268032770 2024-09-13T11:12:01.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fb275a0d640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb254072500 0x7fb2540749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71140c7f40 con 0x7f71140345f0 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711402b060 con 0x7f71140345f0 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150011790 con 0x7f815c033660 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8150017070 con 0x7f815c033660 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150011bb0 con 0x7f815c033660 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815c160140 con 0x7f815c033660 2024-09-13T11:12:01.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f815c0cc0d0 con 0x7f815c033660 2024-09-13T11:12:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae400fea0 con 0x7feadc0051d0 2024-09-13T11:12:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae4015630 con 0x7feadc0051d0 2024-09-13T11:12:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4015a20 con 0x7feadc0051d0 2024-09-13T11:12:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 -- start start 2024-09-13T11:12:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 0x7efde41ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4071860 0x7efde413b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efde41429a0 0x7efde40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efde414df10 con 0x7efde4070630 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efde414dd90 con 0x7efde4071860 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdea01d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7efde414e090 con 0x7efde41429a0 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 0x7efde41ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 0x7efde41ec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53146/0 (socket says 172.21.15.39:53146) 2024-09-13T11:12:01.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 -- 172.21.15.39:0/404286523 learned_addr learned my addr 172.21.15.39:0/404286523 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fb275a0d640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb254072500 0x7fb2540749c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0ad000 tx=0x7fb26c004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fb276a0f640 1 -- 172.21.15.39:0/2635534225 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb258005090 con 0x7fb268032770 2024-09-13T11:12:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71180b2880 con 0x7f71140345f0 2024-09-13T11:12:01.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde2ffd640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4071860 0x7efde413b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffad83640 1 -- 172.21.15.39:0/2186882107 shutdown_connections 2024-09-13T11:12:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f5ffad83640 1 -- 172.21.15.39:0/2186882107 wait complete. 2024-09-13T11:12:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf4142cf0 con 0x7feadc0051d0 2024-09-13T11:12:01.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41d5330 con 0x7feadc0051d0 2024-09-13T11:12:01.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815c033120 con 0x7f815c033660 2024-09-13T11:12:01.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71140c3dc0 con 0x7f71140345f0 2024-09-13T11:12:01.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 -- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efde41429a0 msgr2=0x7efde40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efde41429a0 0x7efde40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 -- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4071860 msgr2=0x7efde413b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4071860 0x7efde413b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 -- 172.21.15.39:0/404286523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41e6400 con 0x7efde4070630 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efde37fe640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 0x7efde41ec0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c420 tx=0x7efdd400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4017070 con 0x7efde4070630 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd40052d0 con 0x7efde4070630 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 Processor -- start 2024-09-13T11:12:01.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f815001c460 con 0x7f815c033660 2024-09-13T11:12:01.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40054c0 con 0x7efde4070630 2024-09-13T11:12:01.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41ecad0 con 0x7efde4070630 2024-09-13T11:12:01.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde40af250 con 0x7efde4070630 2024-09-13T11:12:01.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f81617fa640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f8148072100 0x7f81480745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f8150092500 con 0x7f815c033660 2024-09-13T11:12:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f8168f1f640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f8148072100 0x7f81480745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 -- start start 2024-09-13T11:12:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 0x7f5ff414aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ff40af1b0 0x7f5ff40ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff40ac460 0x7f5ff41dc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4147c90 con 0x7f5ff40af1b0 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff40700c0 con 0x7f5fe00051d0 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ffad83640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f5ff4147e10 con 0x7f5ff40ac460 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9d81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 0x7f5ff414aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9d81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 0x7f5ff414aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:59160/0 (socket says 172.21.15.39:59160) 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9d81640 1 -- 172.21.15.39:0/1135280545 learned_addr learned my addr 172.21.15.39:0/1135280545 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ff40af1b0 0x7f5ff40ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf4144130 con 0x7feadc0051d0 2024-09-13T11:12:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 -- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff40ac460 msgr2=0x7f5ff41dc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff40ac460 0x7f5ff41dc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 -- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 msgr2=0x7f5ff414aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 0x7f5ff414aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 -- 172.21.15.39:0/1135280545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40adde0 con 0x7f5ff40af1b0 2024-09-13T11:12:01.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9d81640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 0x7f5ff414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7feae4015bc0 con 0x7feadc0051d0 2024-09-13T11:12:01.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f8168f1f640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f8148072100 0x7f81480745c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81640526a0 tx=0x7f816408e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f5ff9580640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ff40af1b0 0x7f5ff40ae200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406c010 tx=0x7f5fe4010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7feaf27fc640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7feae0072200 0x7feae00746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7feae40938c0 con 0x7feadc0051d0 2024-09-13T11:12:01.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.075+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa488005090 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde4142d80 con 0x7efde4070630 2024-09-13T11:12:01.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f71180b0070 con 0x7f71140345f0 2024-09-13T11:12:01.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7feaf9388640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7feae0072200 0x7feae00746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f7112ffd640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7100072150 0x7f7100074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fa498010610 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f711812ce30 con 0x7f71140345f0 2024-09-13T11:12:01.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f7121d92640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7100072150 0x7f7100074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f85cd1e0640 1 Processor -- start 2024-09-13T11:12:01.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.079+0000 7f85cd1e0640 1 -- start start 2024-09-13T11:12:01.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85cd1e0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f85c80703f0 0x7f85c80af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85cd1e0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 0x7f85c8153870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7fa49dffb640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa4940722c0 0x7fa494074780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fa49809a8a0 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7feaf9388640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7feae0072200 0x7feae00746c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaec001ec0 tx=0x7feaec01a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85cd1e0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85c8074920 con 0x7f85c8153db0 2024-09-13T11:12:01.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85cd1e0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f85c80707d0 con 0x7f85c80703f0 2024-09-13T11:12:01.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85cd1e0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f85c8070c40 con 0x7f85c8071410 2024-09-13T11:12:01.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 0x7f85c8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 0x7f85c8153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53370/0 (socket says 172.21.15.39:53370) 2024-09-13T11:12:01.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85cc9df640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f85c8153db0 0x7f85c8073650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39570/0 (socket says 172.21.15.39:39570) 2024-09-13T11:12:01.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 -- 172.21.15.39:0/1899845199 learned_addr learned my addr 172.21.15.39:0/1899845199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c7fff640 1 --2- 172.21.15.39:0/1899845199 >> v2:172.21.15.102:3300/0 conn(0x7f85c80703f0 0x7f85c80af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 -- 172.21.15.39:0/1899845199 >> v2:172.21.15.102:3300/0 conn(0x7f85c80703f0 msgr2=0x7f85c80af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:01.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 --2- 172.21.15.39:0/1899845199 >> v2:172.21.15.102:3300/0 conn(0x7f85c80703f0 0x7f85c80af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 -- 172.21.15.39:0/1899845199 >> v1:172.21.15.39:6789/0 conn(0x7f85c8153db0 legacy=0x7f85c8073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 -- 172.21.15.39:0/1899845199 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c80723e0 con 0x7f85c8071410 2024-09-13T11:12:01.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7fa4acaac640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa4940722c0 0x7fa494074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f7121d92640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7100072150 0x7f7100074610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71140c6c70 tx=0x7f710c007f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7fa4acaac640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa4940722c0 0x7fa494074780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80b8620 tx=0x7fa4a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.151 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7f85c77fe640 1 --2- 172.21.15.39:0/1899845199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 0x7f85c8153870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0098a0 tx=0x7f85bc01e680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d77896cefe0af258 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.083+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb2600617f0 con 0x7fb268032770 2024-09-13T11:12:01.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.087+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7118017480 con 0x7f71140345f0 2024-09-13T11:12:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.087+0000 7f85c6ffd640 1 -- 172.21.15.39:0/1899845199 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0ae070 con 0x7f85c8071410 2024-09-13T11:12:01.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.087+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8150003810 con 0x7f815c033660 2024-09-13T11:12:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85c6ffd640 1 -- 172.21.15.39:0/1899845199 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc0a8650 con 0x7f85c8071410 2024-09-13T11:12:01.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85c6ffd640 1 -- 172.21.15.39:0/1899845199 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0a8a20 con 0x7f85c8071410 2024-09-13T11:12:01.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 -- 172.21.15.39:0/1899845199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 msgr2=0x7f85c8153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/1899845199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 0x7f85c8153870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f85bc0098a0 tx=0x7f85bc01e680 comp rx=0 tx=0).stop 2024-09-13T11:12:01.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 -- 172.21.15.39:0/1899845199 shutdown_connections 2024-09-13T11:12:01.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/1899845199 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8071410 0x7f85c8153870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/1899845199 >> v2:172.21.15.102:3300/0 conn(0x7f85c80703f0 0x7f85c80af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 -- 172.21.15.39:0/1899845199 >> 172.21.15.39:0/1899845199 conn(0x7f85c80b4d40 msgr2=0x7f85c80b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400f040 con 0x7f5ff40af1b0 2024-09-13T11:12:01.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 -- 172.21.15.39:0/1899845199 shutdown_connections 2024-09-13T11:12:01.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff40ab710 con 0x7f5ff40af1b0 2024-09-13T11:12:01.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff40acab0 con 0x7f5ff40af1b0 2024-09-13T11:12:01.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f85cd1e0640 1 -- 172.21.15.39:0/1899845199 wait complete. 2024-09-13T11:12:01.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff40af890 con 0x7f5ff40af1b0 2024-09-13T11:12:01.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7efdd401a070 con 0x7efde4070630 2024-09-13T11:12:01.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7efdcbfff640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7efdd0072150 0x7efdd0074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7feaf4142cf0 con 0x7feadc0051d0 2024-09-13T11:12:01.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.091+0000 7efde2ffd640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7efdd0072150 0x7efdd0074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 Processor -- start 2024-09-13T11:12:01.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 -- start start 2024-09-13T11:12:01.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7efde2ffd640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7efdd0072150 0x7efdd0074610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efddc007fd0 tx=0x7efddc007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85c80703f0 0x7f85c8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 0x7f85c81e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8153db0 0x7f85c81e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 0x7f85c81e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 0x7f85c81e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53166/0 (socket says 172.21.15.39:53166) 2024-09-13T11:12:01.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85c80703f0 0x7f85c8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85c80703f0 0x7f85c8154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:59180/0 (socket says 172.21.15.39:59180) 2024-09-13T11:12:01.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cc9df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8153db0 0x7f85c81e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cc9df640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8153db0 0x7f85c81e94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53380/0 (socket says 172.21.15.39:53380) 2024-09-13T11:12:01.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 -- 172.21.15.39:0/284772456 learned_addr learned my addr 172.21.15.39:0/284772456 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:01.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8073ee0 con 0x7f85c8071410 2024-09-13T11:12:01.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8073d60 con 0x7f85c80703f0 2024-09-13T11:12:01.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f85c81541e0 con 0x7f85c8153db0 2024-09-13T11:12:01.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 -- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8153db0 msgr2=0x7f85c81e94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8153db0 0x7f85c81e94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 -- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85c80703f0 msgr2=0x7f85c8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85c80703f0 0x7f85c8154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c81552a0 con 0x7f85c8071410 2024-09-13T11:12:01.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.095+0000 7f85c77fe640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 0x7f85c81e8f70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01cd30 tx=0x7f85bc01b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe4004230 con 0x7f5ff40af1b0 2024-09-13T11:12:01.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4021060 con 0x7f5ff40af1b0 2024-09-13T11:12:01.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa498066510 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7efdd4059410 con 0x7efde4070630 2024-09-13T11:12:01.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0ae070 con 0x7f85c8071410 2024-09-13T11:12:01.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c8156a70 con 0x7f85c8071410 2024-09-13T11:12:01.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c81e99f0 con 0x7f85c8071410 2024-09-13T11:12:01.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.099+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c81545c0 con 0x7f85c8071410 2024-09-13T11:12:01.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.103+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7efdd4021080 con 0x7efde4070630 2024-09-13T11:12:01.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.103+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc0ba070 con 0x7f85c8071410 2024-09-13T11:12:01.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.103+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0b3860 con 0x7f85c8071410 2024-09-13T11:12:01.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f5fe400e960 con 0x7f5ff40af1b0 2024-09-13T11:12:01.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f5fea7fc640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5fd8072130 0x7f5fd80745f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f5fe4092ec0 con 0x7f5ff40af1b0 2024-09-13T11:12:01.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f5ff9d81640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5fd8072130 0x7f5fd80745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f5ff9d81640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5fd8072130 0x7f5fd80745f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0104b0 tx=0x7f5fec003af0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f85bc0b1070 con 0x7f85c8071410 2024-09-13T11:12:01.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f85c4ff9640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f85b4072100 0x7f85b40745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:01.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.107+0000 7f85c7fff640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f85b4072100 0x7f85b40745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:01.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.111+0000 7f85c7fff640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f85b4072100 0x7f85b40745c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85b8007a60 tx=0x7f85b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:01.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.111+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5fe4018070 con 0x7f5ff40af1b0 2024-09-13T11:12:01.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.111+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f85bc0f4a40 con 0x7f85c8071410 2024-09-13T11:12:01.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.119+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f85bc018330 con 0x7f85c8071410 2024-09-13T11:12:01.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.431+0000 7fb276a0f640 1 -- 172.21.15.39:0/2635534225 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb258005650 con 0x7fb268032770 2024-09-13T11:12:01.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.431+0000 7fb2667fc640 1 -- 172.21.15.39:0/2635534225 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb260065fb0 con 0x7fb268032770 2024-09-13T11:12:01.435 INFO:teuthology.orchestra.run.smithi039.stdout:55834574852 2024-09-13T11:12:01.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f71140c2140 con 0x7f71140345f0 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 -- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb254072500 msgr2=0x7fb2540749c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb254072500 0x7fb2540749c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0ad000 tx=0x7fb26c004740 comp rx=0 tx=0).stop 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 -- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 msgr2=0x7fb2680c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 0x7fb2680c3e10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb26000d630 tx=0x7fb26000daf0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 -- 172.21.15.39:0/2635534225 shutdown_connections 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb254072500 0x7fb2540749c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2680c4350 0x7fb26815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb268032770 0x7fb2680c3e10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 --2- 172.21.15.39:0/2635534225 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb2680303e0 0x7fb26802c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7fb253fff640 1 -- 172.21.15.39:0/2635534225 >> 172.21.15.39:0/2635534225 conn(0x7fb26803a110 msgr2=0x7fb268037910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.435+0000 7f7112ffd640 1 -- 172.21.15.39:0/3782512264 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f71180f8340 con 0x7f71140345f0 2024-09-13T11:12:01.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7fb253fff640 1 -- 172.21.15.39:0/2635534225 shutdown_connections 2024-09-13T11:12:01.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7fb253fff640 1 -- 172.21.15.39:0/2635534225 wait complete. 2024-09-13T11:12:01.441 INFO:teuthology.orchestra.run.smithi039.stdout:55834574852 2024-09-13T11:12:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7100072150 msgr2=0x7f7100074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7100072150 0x7f7100074610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71140c6c70 tx=0x7f710c007f60 comp rx=0 tx=0).stop 2024-09-13T11:12:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 msgr2=0x7f71140c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 0x7f71140c6730 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f711801be20 tx=0x7f711801a510 comp rx=0 tx=0).stop 2024-09-13T11:12:01.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 shutdown_connections 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7100072150 0x7f7100074610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f71140cbd50 0x7f711402ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71140c4300 0x7f7114167c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 --2- 172.21.15.39:0/3782512264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f71140345f0 0x7f71140c6730 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 >> 172.21.15.39:0/3782512264 conn(0x7f7114005c30 msgr2=0x7f71140381c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f815c15f3e0 con 0x7f815c033660 2024-09-13T11:12:01.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.439+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 shutdown_connections 2024-09-13T11:12:01.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.443+0000 7f7123595640 1 -- 172.21.15.39:0/3782512264 wait complete. 2024-09-13T11:12:01.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.443+0000 7f81617fa640 1 -- 172.21.15.39:0/541046999 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f815005d9a0 con 0x7f815c033660 2024-09-13T11:12:01.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.447+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feaf41487e0 con 0x7feadc0051d0 2024-09-13T11:12:01.448 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:01.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.447+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa488005650 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.447+0000 7fa49dffb640 1 -- 172.21.15.39:0/3953937376 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa498065e10 con 0x7fa4a80aa4c0 2024-09-13T11:12:01.449 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-13T11:12:01.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.447+0000 7feaf27fc640 1 -- 172.21.15.39:0/1230436961 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feae4019030 con 0x7feadc0051d0 2024-09-13T11:12:01.449 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-13T11:12:01.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f8148072100 msgr2=0x7f81480745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f8148072100 0x7f81480745c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81640526a0 tx=0x7f816408e040 comp rx=0 tx=0).stop 2024-09-13T11:12:01.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa4940722c0 msgr2=0x7fa494074780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 msgr2=0x7f815c15f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 0x7f815c15f6c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f815000c410 tx=0x7f815000c8d0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa4940722c0 0x7fa494074780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80b8620 tx=0x7fa4a4008040 comp rx=0 tx=0).stop 2024-09-13T11:12:01.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 msgr2=0x7fa4a80b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80b7f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b4a0 tx=0x7fa49800b960 comp rx=0 tx=0).stop 2024-09-13T11:12:01.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 shutdown_connections 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa4940722c0 0x7fa494074780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4a813cca0 0x7fa4a813f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa4a80b98f0 0x7fa4a813ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 --2- 172.21.15.39:0/3953937376 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa4a80aa4c0 0x7fa4a80b7f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 >> 172.21.15.39:0/3953937376 conn(0x7fa4a802d600 msgr2=0x7fa4a80b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 shutdown_connections 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 shutdown_connections 2024-09-13T11:12:01.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f8148072100 0x7f81480745c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7fa4af511640 1 -- 172.21.15.39:0/3953937376 wait complete. 2024-09-13T11:12:01.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f815c035e70 0x7f815c15fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f815c033660 0x7f815c15f6c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 --2- 172.21.15.39:0/541046999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f815c006eb0 0x7f815c0ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 >> 172.21.15.39:0/541046999 conn(0x7f815c005d90 msgr2=0x7f815c0c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 shutdown_connections 2024-09-13T11:12:01.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7f8169f21640 1 -- 172.21.15.39:0/541046999 wait complete. 2024-09-13T11:12:01.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7feae0072200 msgr2=0x7feae00746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7feae0072200 0x7feae00746c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaec001ec0 tx=0x7feaec01a040 comp rx=0 tx=0).stop 2024-09-13T11:12:01.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 msgr2=0x7feaf413f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 0x7feaf413f760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feae4009f90 tx=0x7feae400f580 comp rx=0 tx=0).stop 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 shutdown_connections 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7feae0072200 0x7feae00746c0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaec001ec0 tx=0x7feaec01a040 comp rx=0 tx=0).stop 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf4141750 0x7feaf4137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7feaf4143120 0x7feaf41466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 --2- 172.21.15.39:0/1230436961 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feadc0051d0 0x7feaf413f760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 >> 172.21.15.39:0/1230436961 conn(0x7feaf40b4d40 msgr2=0x7feaf4140770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 shutdown_connections 2024-09-13T11:12:01.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.451+0000 7feafab8b640 1 -- 172.21.15.39:0/1230436961 wait complete. 2024-09-13T11:12:01.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.459+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5ff40ac0e0 con 0x7f5ff40af1b0 2024-09-13T11:12:01.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.459+0000 7f5fea7fc640 1 -- 172.21.15.39:0/1135280545 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ff40ac0e0 con 0x7f5ff40af1b0 2024-09-13T11:12:01.462 INFO:teuthology.orchestra.run.smithi039.stdout:55834574852 2024-09-13T11:12:01.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.459+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f85c81500e0 con 0x7f85c8071410 2024-09-13T11:12:01.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.459+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efde40aed50 con 0x7efde4070630 2024-09-13T11:12:01.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f85c4ff9640 1 -- 172.21.15.39:0/284772456 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85bc1012d0 con 0x7f85c8071410 2024-09-13T11:12:01.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7efdcbfff640 1 -- 172.21.15.39:0/404286523 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efdd405d8a0 con 0x7efde4070630 2024-09-13T11:12:01.466 INFO:teuthology.orchestra.run.smithi039.stdout:60129542148 2024-09-13T11:12:01.466 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5fd8072130 msgr2=0x7f5fd80745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5fd8072130 0x7f5fd80745f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0104b0 tx=0x7f5fec003af0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ff40af1b0 msgr2=0x7f5ff40ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ff40af1b0 0x7f5ff40ae200 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ff406c010 tx=0x7f5fe4010d60 comp rx=0 tx=0).stop 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 shutdown_connections 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5fd8072130 0x7f5fd80745f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5ff40ac460 0x7f5ff41dc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5ff40af1b0 0x7f5ff40ae200 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 --2- 172.21.15.39:0/1135280545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fe00051d0 0x7f5ff414aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 >> 172.21.15.39:0/1135280545 conn(0x7f5ff40b57a0 msgr2=0x7f5ff4144f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.463+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 shutdown_connections 2024-09-13T11:12:01.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f5ffad83640 1 -- 172.21.15.39:0/1135280545 wait complete. 2024-09-13T11:12:01.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f85b4072100 msgr2=0x7f85b40745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f85b4072100 0x7f85b40745c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85b8007a60 tx=0x7f85b8008040 comp rx=0 tx=0).stop 2024-09-13T11:12:01.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 msgr2=0x7f85c81e8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 0x7f85c81e8f70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01cd30 tx=0x7f85bc01b420 comp rx=0 tx=0).stop 2024-09-13T11:12:01.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 shutdown_connections 2024-09-13T11:12:01.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f85b4072100 0x7f85b40745c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f85c8153db0 0x7f85c81e94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f85c8071410 0x7f85c81e8f70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 --2- 172.21.15.39:0/284772456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f85c80703f0 0x7f85c8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 >> 172.21.15.39:0/284772456 conn(0x7f85c80b4d40 msgr2=0x7f85c81525c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 shutdown_connections 2024-09-13T11:12:01.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7f85cd1e0640 1 -- 172.21.15.39:0/284772456 wait complete. 2024-09-13T11:12:01.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7efdd0072150 msgr2=0x7efdd0074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7efdd0072150 0x7efdd0074610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efddc007fd0 tx=0x7efddc007ea0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 msgr2=0x7efde41ec0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:01.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 0x7efde41ec0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c420 tx=0x7efdd400c8e0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 shutdown_connections 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7efdd0072150 0x7efdd0074610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7efde41429a0 0x7efde40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efde4071860 0x7efde413b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 --2- 172.21.15.39:0/404286523 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efde4070630 0x7efde41ec0a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 >> 172.21.15.39:0/404286523 conn(0x7efde40b4d40 msgr2=0x7efde413c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 shutdown_connections 2024-09-13T11:12:01.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:01.467+0000 7efdea01d640 1 -- 172.21.15.39:0/404286523 wait complete. 2024-09-13T11:12:01.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-09-13T11:12:01.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-09-13T11:12:01.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-13T11:12:01.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.7 2024-09-13T11:12:01.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2024-09-13T11:12:01.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-13T11:12:01.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-13T11:12:01.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-13T11:12:02.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T11:12:02.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T11:12:02.491 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T11:12:02.491 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T11:12:02.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T11:12:02.499 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T11:12:02.503 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T11:12:02.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T11:12:02.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c2cd60640 1 Processor -- start 2024-09-13T11:12:02.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c2cd60640 1 -- start start 2024-09-13T11:12:02.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c2cd60640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c28070630 0x7f4c28142d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c2cd60640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c280749c0 con 0x7f4c28071860 2024-09-13T11:12:02.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c2cd60640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c28072a60 con 0x7f4c281429a0 2024-09-13T11:12:02.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c2cd60640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4c28073870 con 0x7f4c28070630 2024-09-13T11:12:02.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c25d9b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4c28071860 0x7f4c28073160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39586/0 (socket says 172.21.15.39:39586) 2024-09-13T11:12:02.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.659+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3825129178 learned_addr learned my addr 172.21.15.39:0/3825129178 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:02.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c26d9d640 1 --2- 172.21.15.39:0/3825129178 >> v2:172.21.15.102:3300/0 conn(0x7f4c28070630 0x7f4c28142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196200342 0 0) 0x7f4c280749c0 con 0x7f4c28071860 2024-09-13T11:12:02.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c10003530 con 0x7f4c28071860 2024-09-13T11:12:02.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959120608 0 0) 0x7f4c28072a60 con 0x7f4c281429a0 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c280749c0 con 0x7f4c281429a0 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982989086 0 0) 0x7f4c10003530 con 0x7f4c28071860 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 >> v2:172.21.15.102:3300/0 conn(0x7f4c28070630 msgr2=0x7f4c28142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 --2- 172.21.15.39:0/3825129178 >> v2:172.21.15.102:3300/0 conn(0x7f4c28070630 0x7f4c28142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 >> v1:172.21.15.102:6789/0 conn(0x7f4c281429a0 legacy=0x7f4c280742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c280739f0 con 0x7f4c28071860 2024-09-13T11:12:02.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f4c20001a80 con 0x7f4c28071860 2024-09-13T11:12:02.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 >> v1:172.21.15.39:6789/0 conn(0x7f4c28071860 legacy=0x7f4c28073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c10003c40 0x7f4c10004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c10004810 0x7f4c10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c10005270 0x7f4c1000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4c28073870 con 0x7f4c10004810 2024-09-13T11:12:02.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2659c640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c10003c40 0x7f4c10004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1000c1c0 con 0x7f4c10005270 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c10004810 0x7f4c10004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4c1000c3c0 con 0x7f4c10003c40 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c26d9d640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c10005270 0x7f4c1000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c10003c40 msgr2=0x7f4c10004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c10003c40 0x7f4c10004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3825129178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c10005270 msgr2=0x7f4c1000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c10005270 0x7f4c1000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3825129178 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c10003530 con 0x7f4c10004810 2024-09-13T11:12:02.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c2659c640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c10003c40 0x7f4c10004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:02.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c26d9d640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c10005270 0x7f4c1000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:02.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.663+0000 7f4c26d9d640 1 -- 172.21.15.39:0/3825129178 reap_dead start 2024-09-13T11:12:02.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.667+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c10004810 0x7f4c10004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000a9e0 tx=0x7f4c2001fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b2f773325ec7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.667+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2000a630 con 0x7f4c10004810 2024-09-13T11:12:02.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.667+0000 7f4c2559a640 1 -- 172.21.15.39:0/3825129178 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c20009370 con 0x7f4c10004810 2024-09-13T11:12:02.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c10004810 msgr2=0x7f4c10004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c10004810 0x7f4c10004c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000a9e0 tx=0x7f4c2001fb70 comp rx=0 tx=0).stop 2024-09-13T11:12:02.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3825129178 shutdown_connections 2024-09-13T11:12:02.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 --2- 172.21.15.39:0/3825129178 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c10004810 0x7f4c10004c90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3825129178 >> 172.21.15.39:0/3825129178 conn(0x7f4c280b4d40 msgr2=0x7f4c280b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3825129178 shutdown_connections 2024-09-13T11:12:02.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3825129178 wait complete. 2024-09-13T11:12:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 Processor -- start 2024-09-13T11:12:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- start start 2024-09-13T11:12:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c281495a0 0x7f4c28144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c28149980 0x7f4c281458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c281e9160 0x7f4c28148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4c280732a0 con 0x7f4c28149980 2024-09-13T11:12:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c28073120 con 0x7f4c281e9160 2024-09-13T11:12:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.671+0000 7f4c2cd60640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4c28073420 con 0x7f4c281495a0 2024-09-13T11:12:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c2659c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c281495a0 0x7f4c28144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c28149980 0x7f4c281458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c2659c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c281495a0 0x7f4c28144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53396/0 (socket says 172.21.15.39:53396) 2024-09-13T11:12:02.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c2659c640 1 -- 172.21.15.39:0/3535257962 learned_addr learned my addr 172.21.15.39:0/3535257962 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c26d9d640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c281e9160 0x7f4c28148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c281495a0 msgr2=0x7f4c28144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c281495a0 0x7f4c28144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c281e9160 msgr2=0x7f4c28148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c281e9160 0x7f4c28148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 -- 172.21.15.39:0/3535257962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c281e95f0 con 0x7f4c28149980 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c25d9b640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c28149980 0x7f4c281458d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c190 tx=0x7f4c10005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20001a80 con 0x7f4c28149980 2024-09-13T11:12:02.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3535257962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c28143af0 con 0x7f4c28149980 2024-09-13T11:12:02.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3535257962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c28148d60 con 0x7f4c28149980 2024-09-13T11:12:02.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c20001ca0 con 0x7f4c28149980 2024-09-13T11:12:02.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.675+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20002050 con 0x7f4c28149980 2024-09-13T11:12:02.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.679+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f4c200064d0 con 0x7f4c28149980 2024-09-13T11:12:02.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.679+0000 7f4c16ffd640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4c10073ae0 0x7f4c10075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.679+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f4c2012cbd0 con 0x7f4c28149980 2024-09-13T11:12:02.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.679+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3535257962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2813fc30 con 0x7f4c28149980 2024-09-13T11:12:02.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.679+0000 7f4c2659c640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4c10073ae0 0x7f4c10075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.679+0000 7f4c2659c640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4c10073ae0 0x7f4c10075fa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c18001bf0 tx=0x7f4c18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.687+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4c2012ce20 con 0x7f4c28149980 2024-09-13T11:12:02.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.711+0000 7f1860014640 1 Processor -- start 2024-09-13T11:12:02.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.711+0000 7f1860014640 1 -- start start 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f1860014640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f1860014640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1858074180 0x7f1858074610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f1860014640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1858072820 con 0x7f1858070270 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f1860014640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1858074b50 con 0x7f1858074180 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f1860014640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f18581477b0 con 0x7f18580afae0 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185ddb0640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1858070270 0x7f1858147f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39596/0 (socket says 172.21.15.39:39596) 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185ddb0640 1 -- 172.21.15.39:0/2703019500 learned_addr learned my addr 172.21.15.39:0/2703019500 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185e5b1640 1 --2- 172.21.15.39:0/2703019500 >> v2:172.21.15.39:3300/0 conn(0x7f1858074180 0x7f1858074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185d5af640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185cdae640 1 -- 172.21.15.39:0/2703019500 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598264435 0 0) 0x7f1858072820 con 0x7f1858070270 2024-09-13T11:12:02.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185cdae640 1 -- 172.21.15.39:0/2703019500 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1844003530 con 0x7f1858070270 2024-09-13T11:12:02.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185e5b1640 1 -- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 msgr2=0x7f1858070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185e5b1640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185e5b1640 1 -- 172.21.15.39:0/2703019500 >> v1:172.21.15.39:6789/0 conn(0x7f1858070270 legacy=0x7f1858147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185e5b1640 1 -- 172.21.15.39:0/2703019500 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1858148630 con 0x7f1858074180 2024-09-13T11:12:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185d5af640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7fa8cfad0640 1 Processor -- start 2024-09-13T11:12:02.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7fa8cfad0640 1 -- start start 2024-09-13T11:12:02.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f185e5b1640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858074180 0x7f1858074610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1850009d90 tx=0x7f185001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df40de8b3aa52c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f185cdae640 1 -- 172.21.15.39:0/2703019500 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500a6700 con 0x7f1858074180 2024-09-13T11:12:02.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f185cdae640 1 -- 172.21.15.39:0/2703019500 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18500a68a0 con 0x7f1858074180 2024-09-13T11:12:02.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f185cdae640 1 -- 172.21.15.39:0/2703019500 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500a6c70 con 0x7f1858074180 2024-09-13T11:12:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f97a8452640 1 Processor -- start 2024-09-13T11:12:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.715+0000 7f97a8452640 1 -- start start 2024-09-13T11:12:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a8452640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a00717f0 0x7f97a0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a8452640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f97a0074aa0 0x7f97a01400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a8452640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a0074ec0 con 0x7f97a0139cd0 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a8452640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f97a0073be0 con 0x7f97a0074aa0 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a8452640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f97a0073e30 con 0x7f97a00717f0 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cfad0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8c80b59d0 0x7fa8c80706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cfad0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa8c813c7e0 0x7fa8c813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cfad0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c8072c80 con 0x7fa8c813c390 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cfad0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c8074510 con 0x7fa8c80b59d0 2024-09-13T11:12:02.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cfad0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c8072a30 con 0x7fa8c813c7e0 2024-09-13T11:12:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f97a0074aa0 0x7f97a01400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cd06b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa8c813c390 0x7fa8c813f3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39612/0 (socket says 172.21.15.39:39612) 2024-09-13T11:12:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cd06b640 1 -- 172.21.15.39:0/1571606210 learned_addr learned my addr 172.21.15.39:0/1571606210 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cd86c640 1 --2- 172.21.15.39:0/1571606210 >> v2:172.21.15.39:3300/0 conn(0x7fa8c80b59d0 0x7fa8c80706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f97a0074aa0 0x7f97a01400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53212/0 (socket says 172.21.15.39:53212) 2024-09-13T11:12:02.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 -- 172.21.15.39:0/3046762415 learned_addr learned my addr 172.21.15.39:0/3046762415 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8ce06d640 1 --2- 172.21.15.39:0/1571606210 >> v2:172.21.15.102:3300/0 conn(0x7fa8c813c7e0 0x7fa8c813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 -- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858074180 msgr2=0x7f1858074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858074180 0x7f1858074610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1850009d90 tx=0x7f185001c830 comp rx=0 tx=0).stop 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 -- 172.21.15.39:0/2703019500 shutdown_connections 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858074180 0x7f1858074610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 --2- 172.21.15.39:0/2703019500 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 -- 172.21.15.39:0/2703019500 >> 172.21.15.39:0/2703019500 conn(0x7f18580b52b0 msgr2=0x7f18580b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea3d277640 1 Processor -- start 2024-09-13T11:12:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a61ee640 1 --2- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a00717f0 0x7f97a0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 -- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a00717f0 msgr2=0x7f97a0071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 --2- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a00717f0 0x7f97a0071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 -- 172.21.15.39:0/3046762415 >> v1:172.21.15.102:6789/0 conn(0x7f97a0139cd0 legacy=0x7f97a0143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f97a59ed640 1 -- 172.21.15.39:0/3046762415 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a0074580 con 0x7f97a0074aa0 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8ce06d640 1 -- 172.21.15.39:0/1571606210 >> v2:172.21.15.39:3300/0 conn(0x7fa8c80b59d0 msgr2=0x7fa8c80706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8ce06d640 1 --2- 172.21.15.39:0/1571606210 >> v2:172.21.15.39:3300/0 conn(0x7fa8c80b59d0 0x7fa8c80706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8ce06d640 1 -- 172.21.15.39:0/1571606210 >> v1:172.21.15.39:6789/0 conn(0x7fa8c813c390 legacy=0x7fa8c813f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cc86a640 1 -- 172.21.15.39:0/1571606210 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548408341 0 0) 0x7fa8c8072c80 con 0x7fa8c813c390 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8ce06d640 1 -- 172.21.15.39:0/1571606210 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c813cf00 con 0x7fa8c813c7e0 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa8cd86c640 1 --2- 172.21.15.39:0/1571606210 >> v2:172.21.15.39:3300/0 conn(0x7fa8c80b59d0 0x7fa8c80706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:02.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea3d277640 1 -- start start 2024-09-13T11:12:02.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 -- 172.21.15.39:0/2703019500 shutdown_connections 2024-09-13T11:12:02.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 -- 172.21.15.39:0/2703019500 wait complete. 2024-09-13T11:12:02.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 Processor -- start 2024-09-13T11:12:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea3d277640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea38071a80 0x7fea381434e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea3d277640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea380729e0 con 0x7fea381429c0 2024-09-13T11:12:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea3d277640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea380b0320 con 0x7fea38070b20 2024-09-13T11:12:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea3d277640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fea380717c0 con 0x7fea38071a80 2024-09-13T11:12:02.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 Processor -- start 2024-09-13T11:12:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea36ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fea381429c0 0x7fea380afc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39614/0 (socket says 172.21.15.39:39614) 2024-09-13T11:12:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea36ffd640 1 -- 172.21.15.39:0/1068859284 learned_addr learned my addr 172.21.15.39:0/1068859284 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 -- start start 2024-09-13T11:12:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d00706d0 0x7fb4d013c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fea367fc640 1 --2- 172.21.15.39:0/1068859284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea38071a80 0x7fea381434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb4d013c8d0 0x7fb4d013fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d0072c80 con 0x7fb4d0070ab0 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb4d0074510 con 0x7fb4d013c8d0 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4d5b2e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d0072a30 con 0x7fb4d00706d0 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943782870 0 0) 0x7fea380b0320 con 0x7fea38070b20 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea20005740 con 0x7fea38070b20 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482409517 0 0) 0x7fea280049f0 con 0x7fea381429c0 2024-09-13T11:12:02.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea380b0320 con 0x7fea381429c0 2024-09-13T11:12:02.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea367fc640 1 -- 172.21.15.39:0/1068859284 >> v1:172.21.15.102:6789/0 conn(0x7fea38070b20 legacy=0x7fea380b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea367fc640 1 -- 172.21.15.39:0/1068859284 >> v1:172.21.15.39:6789/0 conn(0x7fea381429c0 legacy=0x7fea380afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea367fc640 1 -- 172.21.15.39:0/1068859284 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea380b1170 con 0x7fea38071a80 2024-09-13T11:12:02.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fb4cffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb4d013c8d0 0x7fb4d013fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb4d013c8d0 0x7fb4d013fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:59228/0 (socket says 172.21.15.39:59228) 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cffff640 1 -- 172.21.15.39:0/3543035812 learned_addr learned my addr 172.21.15.39:0/3543035812 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 Processor -- start 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 -- start start 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa000038a20 0x7fa0000cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa0000ced50 0x7fa000033e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa000036ed0 con 0x7fa000033290 2024-09-13T11:12:02.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa000038e00 con 0x7fa000038a20 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00759e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa0000cf320 con 0x7fa0000ced50 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa006d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa000033290 0x7fa0000cb850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.39:44374/0 (socket says 172.21.15.39:44374) 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa006d9d640 1 -- 172.21.15.39:0/454774354 learned_addr learned my addr 172.21.15.39:0/454774354 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7fa00659c640 1 --2- 172.21.15.39:0/454774354 >> v2:172.21.15.39:3300/0 conn(0x7fa000038a20 0x7fa0000cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa00659c640 1 -- 172.21.15.39:0/454774354 >> v2:172.21.15.102:3300/0 conn(0x7fa0000ced50 msgr2=0x7fa000033e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa00659c640 1 --2- 172.21.15.39:0/454774354 >> v2:172.21.15.102:3300/0 conn(0x7fa0000ced50 0x7fa000033e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa00659c640 1 -- 172.21.15.39:0/454774354 >> v1:172.21.15.102:6789/0 conn(0x7fa000033290 legacy=0x7fa0000cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa00659c640 1 -- 172.21.15.39:0/454774354 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0000343b0 con 0x7fa000038a20 2024-09-13T11:12:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a59ed640 1 --2- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a01400a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f979000bb10 tx=0x7f9790021400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ae3cb2556ea828 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cffff640 1 -- 172.21.15.39:0/3543035812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d00706d0 msgr2=0x7fb4d013c390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T11:12:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a51ec640 1 -- 172.21.15.39:0/3046762415 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900b6070 con 0x7f97a0074aa0 2024-09-13T11:12:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a51ec640 1 -- 172.21.15.39:0/3046762415 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97900b1600 con 0x7f97a0074aa0 2024-09-13T11:12:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a51ec640 1 -- 172.21.15.39:0/3046762415 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900b19d0 con 0x7f97a0074aa0 2024-09-13T11:12:02.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 -- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 msgr2=0x7f97a01400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 --2- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a01400a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f979000bb10 tx=0x7f9790021400 comp rx=0 tx=0).stop 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 -- 172.21.15.39:0/3046762415 shutdown_connections 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 --2- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a01400a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 --2- 172.21.15.39:0/3046762415 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a00717f0 0x7f97a0071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 -- 172.21.15.39:0/3046762415 >> 172.21.15.39:0/3046762415 conn(0x7f97a00b6330 msgr2=0x7f97a00b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.719+0000 7f1860014640 1 -- start start 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858070270 0x7f18581405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1858074180 0x7f1858143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1858154af0 con 0x7f1858070270 2024-09-13T11:12:02.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1858147a90 con 0x7f1858074180 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f1858154c70 con 0x7f18580afae0 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53458/0 (socket says 172.21.15.39:53458) 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 -- 172.21.15.39:0/1773356209 learned_addr learned my addr 172.21.15.39:0/1773356209 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185d5af640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1858074180 0x7f1858143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 -- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1858074180 msgr2=0x7f1858143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1858074180 0x7f1858143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 -- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858070270 msgr2=0x7f18581405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858070270 0x7f18581405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 -- 172.21.15.39:0/1773356209 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18580aa5d0 con 0x7f18580afae0 2024-09-13T11:12:02.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8ce06d640 1 --2- 172.21.15.39:0/1571606210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c813fad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8c813f300 tx=0x7fa8c001c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e06a0f9d24c3fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cc86a640 1 -- 172.21.15.39:0/1571606210 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00a66d0 con 0x7fa8c813c7e0 2024-09-13T11:12:02.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cf7fe640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d00706d0 0x7fb4d013c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f185e5b1640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858143f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18500b0040 tx=0x7f18500195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cffff640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d00706d0 0x7fb4d013c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cffff640 1 -- 172.21.15.39:0/3543035812 >> v1:172.21.15.102:6789/0 conn(0x7fb4d0070ab0 legacy=0x7fb4d013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fb4cffff640 1 -- 172.21.15.39:0/3543035812 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d013cf00 con 0x7fb4d013c8d0 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500be070 con 0x7f18580afae0 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cc86a640 1 -- 172.21.15.39:0/1571606210 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c00a6870 con 0x7fa8c813c7e0 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cc86a640 1 -- 172.21.15.39:0/1571606210 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c00a6c40 con 0x7fa8c813c7e0 2024-09-13T11:12:02.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1571606210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 msgr2=0x7fa8c813fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1571606210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c813fad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8c813f300 tx=0x7fa8c001c7f0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18500b8840 con 0x7f18580afae0 2024-09-13T11:12:02.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500b8c10 con 0x7f18580afae0 2024-09-13T11:12:02.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea367fc640 1 --2- 172.21.15.39:0/1068859284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea38071a80 0x7fea381434e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00a990 tx=0x7fea2c024e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c800667c8492b321 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1571606210 shutdown_connections 2024-09-13T11:12:02.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1571606210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c813fad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1571606210 >> v2:172.21.15.39:3300/0 conn(0x7fa8c80b59d0 0x7fa8c80706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1571606210 >> 172.21.15.39:0/1571606210 conn(0x7fa8c80b4eb0 msgr2=0x7fa8c80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0b9070 con 0x7fea38071a80 2024-09-13T11:12:02.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18580aa8b0 con 0x7f18580afae0 2024-09-13T11:12:02.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18580aafb0 con 0x7f18580afae0 2024-09-13T11:12:02.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2c0b4600 con 0x7fea38071a80 2024-09-13T11:12:02.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7fa00659c640 1 --2- 172.21.15.39:0/454774354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000038a20 0x7fa0000cf7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa000039020 tx=0x7f9ff801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07de16d6ec0f461 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1858074610 con 0x7f18580afae0 2024-09-13T11:12:02.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.723+0000 7f97a8452640 1 -- 172.21.15.39:0/3046762415 shutdown_connections 2024-09-13T11:12:02.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1571606210 shutdown_connections 2024-09-13T11:12:02.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea35ffb640 1 -- 172.21.15.39:0/1068859284 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00b040 con 0x7fea38071a80 2024-09-13T11:12:02.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4cf7fe640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d00706d0 0x7fb4d013c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:02.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4cffff640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d013c8d0 0x7fb4d013fad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800d370 tx=0x7fb4c801ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6381574bf5f62c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00559a640 1 -- 172.21.15.39:0/454774354 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80ab610 con 0x7fa000038a20 2024-09-13T11:12:02.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00559a640 1 -- 172.21.15.39:0/454774354 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff80b0070 con 0x7fa000038a20 2024-09-13T11:12:02.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00559a640 1 -- 172.21.15.39:0/454774354 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80ab9d0 con 0x7fa000038a20 2024-09-13T11:12:02.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 -- 172.21.15.39:0/3046762415 wait complete. 2024-09-13T11:12:02.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- 172.21.15.39:0/1068859284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea38071a80 msgr2=0x7fea381434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 --2- 172.21.15.39:0/1068859284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea38071a80 0x7fea381434e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00a990 tx=0x7fea2c024e80 comp rx=0 tx=0).stop 2024-09-13T11:12:02.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4ce7fc640 1 -- 172.21.15.39:0/3543035812 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c80ad070 con 0x7fb4d013c8d0 2024-09-13T11:12:02.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4ce7fc640 1 -- 172.21.15.39:0/3543035812 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c80a7ba0 con 0x7fb4d013c8d0 2024-09-13T11:12:02.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4ce7fc640 1 -- 172.21.15.39:0/3543035812 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800be60 con 0x7fb4d013c8d0 2024-09-13T11:12:02.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 -- 172.21.15.39:0/454774354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000038a20 msgr2=0x7fa0000cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 --2- 172.21.15.39:0/454774354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000038a20 0x7fa0000cf7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa000039020 tx=0x7f9ff801c410 comp rx=0 tx=0).stop 2024-09-13T11:12:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- 172.21.15.39:0/1068859284 shutdown_connections 2024-09-13T11:12:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 --2- 172.21.15.39:0/1068859284 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea38071a80 0x7fea381434e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- 172.21.15.39:0/1068859284 >> 172.21.15.39:0/1068859284 conn(0x7fea380b52b0 msgr2=0x7fea380b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- 172.21.15.39:0/1068859284 shutdown_connections 2024-09-13T11:12:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 Processor -- start 2024-09-13T11:12:02.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 -- 172.21.15.39:0/454774354 shutdown_connections 2024-09-13T11:12:02.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 --2- 172.21.15.39:0/454774354 >> v2:172.21.15.102:3300/0 conn(0x7fa0000ced50 0x7fa000033e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 --2- 172.21.15.39:0/454774354 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000038a20 0x7fa0000cf7b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 -- 172.21.15.39:0/454774354 >> 172.21.15.39:0/454774354 conn(0x7fa000005fe0 msgr2=0x7fa0000063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/3543035812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d013c8d0 msgr2=0x7fb4d013fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d013c8d0 0x7fb4d013fad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800d370 tx=0x7fb4c801ed40 comp rx=0 tx=0).stop 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/3543035812 shutdown_connections 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d013c8d0 0x7fb4d013fad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/3543035812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d00706d0 0x7fb4d013c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/3543035812 >> 172.21.15.39:0/3543035812 conn(0x7fb4d00b4eb0 msgr2=0x7fb4d00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/3543035812 shutdown_connections 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/3543035812 wait complete. 2024-09-13T11:12:02.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- 172.21.15.39:0/1068859284 wait complete. 2024-09-13T11:12:02.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 Processor -- start 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 -- 172.21.15.39:0/454774354 shutdown_connections 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 -- start start 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00717f0 0x7f97a013c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a0143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a0139cd0 0x7f97a00ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01405e0 con 0x7f97a0074aa0 2024-09-13T11:12:02.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97a013dc70 con 0x7f97a00717f0 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a8452640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f97a0140760 con 0x7f97a0139cd0 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a59ed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a0143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a59ed640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a0143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53244/0 (socket says 172.21.15.39:53244) 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f97a59ed640 1 -- 172.21.15.39:0/1940708259 learned_addr learned my addr 172.21.15.39:0/1940708259 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f18500c1070 con 0x7f18580afae0 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f184e7fc640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f183c072100 0x7f183c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f185012e170 con 0x7f18580afae0 2024-09-13T11:12:02.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- start start 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 0x7fea3813f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea381429c0 0x7fea38141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3813c0d0 0x7fea3813c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea3814dfa0 con 0x7fea38071a80 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea3814de20 con 0x7fea3813c0d0 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea3d277640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fea3814e120 con 0x7fea381429c0 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fb4d5b2e640 1 Processor -- start 2024-09-13T11:12:02.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f185ddb0640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f183c072100 0x7f183c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1571606210 wait complete. 2024-09-13T11:12:02.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 0x7fea3813f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 0x7fea3813f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53256/0 (socket says 172.21.15.39:53256) 2024-09-13T11:12:02.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fea36ffd640 1 -- 172.21.15.39:0/2912662094 learned_addr learned my addr 172.21.15.39:0/2912662094 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 -- 172.21.15.39:0/454774354 wait complete. 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.727+0000 7fa00759e640 1 Processor -- start 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 -- start start 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a69ef640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a0139cd0 0x7f97a00ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a61ee640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00717f0 0x7f97a013c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea367fc640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea381429c0 0x7fea38141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea377fe640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3813c0d0 0x7fea3813c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea36ffd640 1 -- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea381429c0 msgr2=0x7fea38141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea36ffd640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea381429c0 0x7fea38141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea36ffd640 1 -- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3813c0d0 msgr2=0x7fea3813c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea36ffd640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3813c0d0 0x7fea3813c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea36ffd640 1 -- 172.21.15.39:0/2912662094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3813d620 con 0x7fea38071a80 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea377fe640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3813c0d0 0x7fea3813c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea367fc640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea381429c0 0x7fea38141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 -- start start 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a59ed640 1 -- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a0139cd0 msgr2=0x7f97a00ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a59ed640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a0139cd0 0x7f97a00ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a59ed640 1 -- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00717f0 msgr2=0x7f97a013c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a59ed640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00717f0 0x7f97a013c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a59ed640 1 -- 172.21.15.39:0/1940708259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a00aae90 con 0x7f97a0074aa0 2024-09-13T11:12:02.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f185ddb0640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f183c072100 0x7f183c0745c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1848007fd0 tx=0x7f1848007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 Processor -- start 2024-09-13T11:12:02.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 -- start start 2024-09-13T11:12:02.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea36ffd640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 0x7fea3813f3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c910 tx=0x7fea2800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d00706d0 0x7fb4d0136510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d0070ab0 0x7fb4d01391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4d013c8d0 0x7fb4d01e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d014c970 con 0x7fb4d013c8d0 2024-09-13T11:12:02.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d014c7f0 con 0x7fb4d00706d0 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d014caf0 con 0x7fb4d0070ab0 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d00706d0 0x7fb4d0136510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d00706d0 0x7fb4d0136510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.39:59276/0 (socket says 172.21.15.39:59276) 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cf7fe640 1 -- 172.21.15.39:0/541981683 learned_addr learned my addr 172.21.15.39:0/541981683 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4d013c8d0 0x7fb4d01e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000033290 0x7fa00002f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa000038a20 0x7fa00002ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0000ced50 0x7fa000030ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000d7480 con 0x7fa000033290 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000d7300 con 0x7fa000038a20 2024-09-13T11:12:02.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa0000d7600 con 0x7fa0000ced50 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa006d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0000ced50 0x7fa000030ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa006d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0000ced50 0x7fa000030ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53494/0 (socket says 172.21.15.39:53494) 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa006d9d640 1 -- 172.21.15.39:0/3225910181 learned_addr learned my addr 172.21.15.39:0/3225910181 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000033290 0x7fa00002f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 -- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0000ced50 msgr2=0x7fa000030ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0000ced50 0x7fa000030ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 -- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa000038a20 msgr2=0x7fa00002ceb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa000038a20 0x7fa00002ceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 -- 172.21.15.39:0/3225910181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00002ead0 con 0x7fa000033290 2024-09-13T11:12:02.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 0x7fa8c81409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8c813c390 0x7fa8c81383d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c8138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8074b00 con 0x7fa8c813c390 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8074980 con 0x7fa8c813c7e0 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cfad0640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c81444b0 con 0x7fa8c80b59d0 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 -- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d0070ab0 msgr2=0x7fb4d01391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d0070ab0 0x7fb4d01391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 -- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d00706d0 msgr2=0x7fb4d0136510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d00706d0 0x7fb4d0136510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 -- 172.21.15.39:0/541981683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d01382a0 con 0x7fb4d013c8d0 2024-09-13T11:12:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00659c640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000033290 0x7fa00002f790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80ac000 tx=0x7f9ff801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f97a59ed640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a0143670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f979001fab0 tx=0x7f979001e1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28014070 con 0x7fea38071a80 2024-09-13T11:12:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea28008040 con 0x7fea38071a80 2024-09-13T11:12:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28007dd0 con 0x7fea38071a80 2024-09-13T11:12:02.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3813caa0 con 0x7fea38071a80 2024-09-13T11:12:02.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3813d240 con 0x7fea38071a80 2024-09-13T11:12:02.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 0x7fa8c81409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 0x7fa8c81409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53522/0 (socket says 172.21.15.39:53522) 2024-09-13T11:12:02.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 -- 172.21.15.39:0/1868991865 learned_addr learned my addr 172.21.15.39:0/1868991865 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80b58d0 con 0x7fa000033290 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8ce06d640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c8138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 -- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 msgr2=0x7fa8c8138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c8138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 -- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8c813c390 msgr2=0x7fa8c81383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8c813c390 0x7fa8c81383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa8cd86c640 1 -- 172.21.15.39:0/1868991865 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c8141c80 con 0x7fa8c80b59d0 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4cffff640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4d013c8d0 0x7fb4d01e51e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80af000 tx=0x7fb4c801bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c80c0070 con 0x7fb4d013c8d0 2024-09-13T11:12:02.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d0138580 con 0x7fb4d013c8d0 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d0137440 con 0x7fb4d013c8d0 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8003bb0 con 0x7fb4d013c8d0 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00002ed40 con 0x7fa000033290 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00002f020 con 0x7fa000033290 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff80b5a70 con 0x7fa000033290 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80b5e20 con 0x7fa000033290 2024-09-13T11:12:02.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900c0070 con 0x7f97a0074aa0 2024-09-13T11:12:02.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97900ba420 con 0x7f97a0074aa0 2024-09-13T11:12:02.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.731+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900b6040 con 0x7f97a0074aa0 2024-09-13T11:12:02.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a0142a40 con 0x7f97a0074aa0 2024-09-13T11:12:02.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a00ae490 con 0x7f97a0074aa0 2024-09-13T11:12:02.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa8cd86c640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 0x7fa8c81409a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400ebe0 tx=0x7fa8c400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c80ad040 con 0x7fb4d013c8d0 2024-09-13T11:12:02.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fea28017070 con 0x7fea38071a80 2024-09-13T11:12:02.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fec005090 con 0x7fa000033290 2024-09-13T11:12:02.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a00ae690 con 0x7f97a0074aa0 2024-09-13T11:12:02.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fea1f7fe640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fea240721d0 0x7fea24074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fea28092670 con 0x7fea38071a80 2024-09-13T11:12:02.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b0005090 con 0x7fb4d013c8d0 2024-09-13T11:12:02.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea18005090 con 0x7fea38071a80 2024-09-13T11:12:02.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fea367fc640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fea240721d0 0x7fea24074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1850016540 con 0x7f18580afae0 2024-09-13T11:12:02.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4017070 con 0x7fa8c80b59d0 2024-09-13T11:12:02.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c8141fc0 con 0x7fa8c80b59d0 2024-09-13T11:12:02.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c8143610 con 0x7fa8c80b59d0 2024-09-13T11:12:02.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c4009400 con 0x7fa8c80b59d0 2024-09-13T11:12:02.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4021060 con 0x7fa8c80b59d0 2024-09-13T11:12:02.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7fea367fc640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fea240721d0 0x7fea24074690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0b6000 tx=0x7fea2c00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.735+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f9ff80bd020 con 0x7fa000033290 2024-09-13T11:12:02.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7f9ff6ffd640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9fe8072150 0x7f9fe8074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fb4c8004040 con 0x7fb4d013c8d0 2024-09-13T11:12:02.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fa005d9b640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9fe8072150 0x7f9fe8074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f97900ba7f0 con 0x7f97a0074aa0 2024-09-13T11:12:02.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7f9796ffd640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9784072180 0x7f9784074640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fb4b7fff640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb4bc072150 0x7fb4bc074610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fa005d9b640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9fe8072150 0x7f9fe8074610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc006fd0 tx=0x7f9ffc006b40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fb4cf7fe640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb4bc072150 0x7fb4bc074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fa8c401a070 con 0x7fa8c80b59d0 2024-09-13T11:12:02.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fa8be7fc640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa8ac072100 0x7fa8ac0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7f97a61ee640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9784072180 0x7f9784074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fb4cf7fe640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb4bc072150 0x7fb4bc074610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0006fd0 tx=0x7fb4c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7f97a61ee640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9784072180 0x7f9784074640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97980113e0 tx=0x7f979800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fa8cd06b640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa8ac072100 0x7fa8ac0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.739+0000 7fa8cd06b640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa8ac072100 0x7fa8ac0745c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8007fd0 tx=0x7fa8b80078e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fa8c400ce30 con 0x7fa8c80b59d0 2024-09-13T11:12:02.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fb4c80f4180 con 0x7fb4d013c8d0 2024-09-13T11:12:02.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f9ff80f4d80 con 0x7fa000033290 2024-09-13T11:12:02.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f97900f7970 con 0x7f97a0074aa0 2024-09-13T11:12:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fea380729e0 con 0x7fea38071a80 2024-09-13T11:12:02.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b0005090 con 0x7fa8c80b59d0 2024-09-13T11:12:02.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7f48fd433640 1 Processor -- start 2024-09-13T11:12:02.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.743+0000 7f48fd433640 1 -- start start 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48fd433640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f48f0038a40 0x7f48f0032710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48fd433640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 0x7f48f0033370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48fd433640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f48f00338b0 0x7f48f0033f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48fd433640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f48f0038e20 con 0x7f48f00338b0 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48fd433640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f48f0036bb0 con 0x7f48f0038a40 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48fd433640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f48f0036e20 con 0x7f48f0031010 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 0x7f48f0033370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 0x7f48f0033370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53534/0 (socket says 172.21.15.39:53534) 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 -- 172.21.15.39:0/183022961 learned_addr learned my addr 172.21.15.39:0/183022961 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f6ffd640 1 --2- 172.21.15.39:0/183022961 >> v2:172.21.15.102:3300/0 conn(0x7f48f0038a40 0x7f48f0032710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f77fe640 1 --2- 172.21.15.39:0/183022961 >> v2:172.21.15.39:3300/0 conn(0x7f48f00338b0 0x7f48f0033f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 -- 172.21.15.39:0/183022961 >> v2:172.21.15.102:3300/0 conn(0x7f48f0038a40 msgr2=0x7f48f0032710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 --2- 172.21.15.39:0/183022961 >> v2:172.21.15.102:3300/0 conn(0x7f48f0038a40 0x7f48f0032710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 -- 172.21.15.39:0/183022961 >> v2:172.21.15.39:3300/0 conn(0x7f48f00338b0 msgr2=0x7f48f0033f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:02.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 --2- 172.21.15.39:0/183022961 >> v2:172.21.15.39:3300/0 conn(0x7f48f00338b0 0x7f48f0033f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 -- 172.21.15.39:0/183022961 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0037100 con 0x7f48f0031010 2024-09-13T11:12:02.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.747+0000 7f48f67fc640 1 --2- 172.21.15.39:0/183022961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 0x7f48f0033370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48f000e2c0 tx=0x7f48ec01c1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d9e2c13a070720 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7f48f5ffb640 1 -- 172.21.15.39:0/183022961 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0b1070 con 0x7f48f0031010 2024-09-13T11:12:02.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa8c8141fc0 con 0x7fa8c80b59d0 2024-09-13T11:12:02.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7f48f5ffb640 1 -- 172.21.15.39:0/183022961 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec0ac440 con 0x7f48f0031010 2024-09-13T11:12:02.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7f48f5ffb640 1 -- 172.21.15.39:0/183022961 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0a4e60 con 0x7f48f0031010 2024-09-13T11:12:02.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa00002ed40 con 0x7fa000033290 2024-09-13T11:12:02.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.759+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb4c80189c0 con 0x7fb4d013c8d0 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7f48fd433640 1 -- 172.21.15.39:0/183022961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 msgr2=0x7f48f0033370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.751+0000 7f48fd433640 1 --2- 172.21.15.39:0/183022961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 0x7f48f0033370 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f48f000e2c0 tx=0x7f48ec01c1d0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- 172.21.15.39:0/183022961 shutdown_connections 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 --2- 172.21.15.39:0/183022961 >> v2:172.21.15.39:3300/0 conn(0x7f48f00338b0 0x7f48f0033f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 --2- 172.21.15.39:0/183022961 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0031010 0x7f48f0033370 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 --2- 172.21.15.39:0/183022961 >> v2:172.21.15.102:3300/0 conn(0x7f48f0038a40 0x7f48f0032710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- 172.21.15.39:0/183022961 >> 172.21.15.39:0/183022961 conn(0x7f48f0005f40 msgr2=0x7f48f0006350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- 172.21.15.39:0/183022961 shutdown_connections 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- 172.21.15.39:0/183022961 wait complete. 2024-09-13T11:12:02.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 Processor -- start 2024-09-13T11:12:02.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- start start 2024-09-13T11:12:02.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f97a00ae690 con 0x7f97a0074aa0 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 0x7f48f002f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48f00338b0 0x7f48f00db200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0038a40 0x7f48f00db740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 0x7f48f002f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f48f00e0630 con 0x7f48f0031010 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48f00e04b0 con 0x7f48f00338b0 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48fd433640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f48f00e07b0 con 0x7f48f0038a40 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 0x7f48f002f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53312/0 (socket says 172.21.15.39:53312) 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 -- 172.21.15.39:0/1893784379 learned_addr learned my addr 172.21.15.39:0/1893784379 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f77fe640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0038a40 0x7f48f00db740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f67fc640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48f00338b0 0x7f48f00db200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 -- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0038a40 msgr2=0x7f48f00db740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0038a40 0x7f48f00db740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 -- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48f00338b0 msgr2=0x7f48f00db200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48f00338b0 0x7f48f00db200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.763+0000 7f48f6ffd640 1 -- 172.21.15.39:0/1893784379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0009d30 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48f6ffd640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 0x7f48f002f560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48e800e870 tx=0x7f48e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8017070 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f000a010 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f000a5d0 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e800c940 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e800ccf0 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.767+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e4005090 con 0x7f48f0031010 2024-09-13T11:12:02.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.771+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f48e801a070 con 0x7f48f0031010 2024-09-13T11:12:02.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.771+0000 7f48df7fe640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f48e0072320 0x7f48e00747e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:02.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.771+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f48e8092d60 con 0x7f48f0031010 2024-09-13T11:12:02.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.771+0000 7f48f67fc640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f48e0072320 0x7f48e00747e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:02.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.775+0000 7f48f67fc640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f48e0072320 0x7f48e00747e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0ae000 tx=0x7f48ec0a6070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:02.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:02.779+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f48e805e280 con 0x7f48f0031010 2024-09-13T11:12:03.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.035+0000 7f4c2cd60640 1 -- 172.21.15.39:0/3535257962 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4c0c0050b0 con 0x7f4c28149980 2024-09-13T11:12:03.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.035+0000 7f4c16ffd640 1 -- 172.21.15.39:0/3535257962 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c20019910 con 0x7f4c28149980 2024-09-13T11:12:03.039 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-09-13T11:12:03.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.039+0000 7f4c14ff9640 1 -- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4c10073ae0 msgr2=0x7f4c10075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.039+0000 7f4c14ff9640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4c10073ae0 0x7f4c10075fa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c18001bf0 tx=0x7f4c18009040 comp rx=0 tx=0).stop 2024-09-13T11:12:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.039+0000 7f4c14ff9640 1 -- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c28149980 msgr2=0x7f4c281458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.039+0000 7f4c14ff9640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c28149980 0x7f4c281458d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c190 tx=0x7f4c10005840 comp rx=0 tx=0).stop 2024-09-13T11:12:03.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 -- 172.21.15.39:0/3535257962 shutdown_connections 2024-09-13T11:12:03.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4c10073ae0 0x7f4c10075fa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c281e9160 0x7f4c28148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4c28149980 0x7f4c281458d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 --2- 172.21.15.39:0/3535257962 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4c281495a0 0x7f4c28144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 -- 172.21.15.39:0/3535257962 >> 172.21.15.39:0/3535257962 conn(0x7f4c280b4d40 msgr2=0x7f4c28141e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 -- 172.21.15.39:0/3535257962 shutdown_connections 2024-09-13T11:12:03.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.047+0000 7f4c14ff9640 1 -- 172.21.15.39:0/3535257962 wait complete. 2024-09-13T11:12:03.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-09-13T11:12:03.070 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.083+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f18580aee10 con 0x7f18580afae0 2024-09-13T11:12:03.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.087+0000 7f184e7fc640 1 -- 172.21.15.39:0/1773356209 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18500f9690 con 0x7f18580afae0 2024-09-13T11:12:03.087 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.087+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f183c072100 msgr2=0x7f183c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.087+0000 7f1860014640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f183c072100 0x7f183c0745c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1848007fd0 tx=0x7f1848007900 comp rx=0 tx=0).stop 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 msgr2=0x7f1858143f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858143f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18500b0040 tx=0x7f18500195d0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 shutdown_connections 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f183c072100 0x7f183c0745c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f18580afae0 0x7f1858143f90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1858074180 0x7f1858143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 --2- 172.21.15.39:0/1773356209 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1858070270 0x7f18581405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 >> 172.21.15.39:0/1773356209 conn(0x7f18580b52b0 msgr2=0x7f1858148fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 shutdown_connections 2024-09-13T11:12:03.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.091+0000 7f1860014640 1 -- 172.21.15.39:0/1773356209 wait complete. 2024-09-13T11:12:03.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.095+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f48d80050b0 con 0x7f48f0031010 2024-09-13T11:12:03.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.095+0000 7f48df7fe640 1 -- 172.21.15.39:0/1893784379 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f48e8062a40 con 0x7f48f0031010 2024-09-13T11:12:03.099 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:03.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f48e0072320 msgr2=0x7f48e00747e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f48e0072320 0x7f48e00747e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0ae000 tx=0x7f48ec0a6070 comp rx=0 tx=0).stop 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 msgr2=0x7f48f002f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 0x7f48f002f560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f48e800e870 tx=0x7f48e800ec70 comp rx=0 tx=0).stop 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 shutdown_connections 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f48e0072320 0x7f48e00747e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f48f0038a40 0x7f48f00db740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48f00338b0 0x7f48f00db200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 --2- 172.21.15.39:0/1893784379 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48f0031010 0x7f48f002f560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 >> 172.21.15.39:0/1893784379 conn(0x7f48f0005f40 msgr2=0x7f48f0006320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 shutdown_connections 2024-09-13T11:12:03.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.099+0000 7f48fd433640 1 -- 172.21.15.39:0/1893784379 wait complete. 2024-09-13T11:12:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.103+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fea18005380 con 0x7fea38071a80 2024-09-13T11:12:03.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.103+0000 7fea1f7fe640 1 -- 172.21.15.39:0/2912662094 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea2805e1e0 con 0x7fea38071a80 2024-09-13T11:12:03.105 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-13T11:12:03.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.103+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa8b0005650 con 0x7fa8c80b59d0 2024-09-13T11:12:03.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fa8be7fc640 1 -- 172.21.15.39:0/1868991865 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8c405db70 con 0x7fa8c80b59d0 2024-09-13T11:12:03.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9fec005650 con 0x7fa000033290 2024-09-13T11:12:03.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7f9ff6ffd640 1 -- 172.21.15.39:0/3225910181 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ff80a8050 con 0x7fa000033290 2024-09-13T11:12:03.108 INFO:teuthology.orchestra.run.smithi039.stdout:60129542149 2024-09-13T11:12:03.108 INFO:teuthology.orchestra.run.smithi039.stdout:60129542150 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fea240721d0 msgr2=0x7fea24074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fea240721d0 0x7fea24074690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0b6000 tx=0x7fea2c00c040 comp rx=0 tx=0).stop 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 msgr2=0x7fea3813f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 0x7fea3813f3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c910 tx=0x7fea2800cdd0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 shutdown_connections 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fea240721d0 0x7fea24074690 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea3813c0d0 0x7fea3813c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fea381429c0 0x7fea38141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 --2- 172.21.15.39:0/2912662094 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea38071a80 0x7fea3813f3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 >> 172.21.15.39:0/2912662094 conn(0x7fea380b52b0 msgr2=0x7fea380b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 shutdown_connections 2024-09-13T11:12:03.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fea3d277640 1 -- 172.21.15.39:0/2912662094 wait complete. 2024-09-13T11:12:03.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.107+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb4b0005650 con 0x7fb4d013c8d0 2024-09-13T11:12:03.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fb4b7fff640 1 -- 172.21.15.39:0/541981683 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4c80f7f10 con 0x7fb4d013c8d0 2024-09-13T11:12:03.111 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9fe8072150 msgr2=0x7f9fe8074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9fe8072150 0x7f9fe8074610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc006fd0 tx=0x7f9ffc006b40 comp rx=0 tx=0).stop 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000033290 msgr2=0x7fa00002f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000033290 0x7fa00002f790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ff80ac000 tx=0x7f9ff801ac50 comp rx=0 tx=0).stop 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 shutdown_connections 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9fe8072150 0x7f9fe8074610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa0000ced50 0x7fa000030ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa000038a20 0x7fa00002ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 --2- 172.21.15.39:0/3225910181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa000033290 0x7fa00002f790 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 >> 172.21.15.39:0/3225910181 conn(0x7fa000005fe0 msgr2=0x7fa000037f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 shutdown_connections 2024-09-13T11:12:03.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa00759e640 1 -- 172.21.15.39:0/3225910181 wait complete. 2024-09-13T11:12:03.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa8ac072100 msgr2=0x7fa8ac0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f97a013a3d0 con 0x7f97a0074aa0 2024-09-13T11:12:03.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa8ac072100 0x7fa8ac0745c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8007fd0 tx=0x7fa8b80078e0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 msgr2=0x7fa8c81409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 0x7fa8c81409a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa8c400ebe0 tx=0x7fa8c400c520 comp rx=0 tx=0).stop 2024-09-13T11:12:03.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7f9796ffd640 1 -- 172.21.15.39:0/1940708259 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9790104020 con 0x7f97a0074aa0 2024-09-13T11:12:03.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 shutdown_connections 2024-09-13T11:12:03.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa8ac072100 0x7fa8ac0745c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.115 INFO:teuthology.orchestra.run.smithi039.stdout:55834574853 2024-09-13T11:12:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8c813c7e0 0x7fa8c8138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8c813c390 0x7fa8c81383d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 --2- 172.21.15.39:0/1868991865 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa8c80b59d0 0x7fa8c81409a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 >> 172.21.15.39:0/1868991865 conn(0x7fa8c80b4eb0 msgr2=0x7fa8c814c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 shutdown_connections 2024-09-13T11:12:03.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.111+0000 7fa8cfad0640 1 -- 172.21.15.39:0/1868991865 wait complete. 2024-09-13T11:12:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb4bc072150 msgr2=0x7fb4bc074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb4bc072150 0x7fb4bc074610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0006fd0 tx=0x7fb4c0008040 comp rx=0 tx=0).stop 2024-09-13T11:12:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4d013c8d0 msgr2=0x7fb4d01e51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4d013c8d0 0x7fb4d01e51e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80af000 tx=0x7fb4c801bae0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 shutdown_connections 2024-09-13T11:12:03.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fb4bc072150 0x7fb4bc074610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-13T11:12:03.118 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb4d013c8d0 0x7fb4d01e51e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fb4d0070ab0 0x7fb4d01391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 --2- 172.21.15.39:0/541981683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4d00706d0 0x7fb4d0136510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 >> 172.21.15.39:0/541981683 conn(0x7fb4d00b4eb0 msgr2=0x7fb4d00afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 shutdown_connections 2024-09-13T11:12:03.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7fb4d5b2e640 1 -- 172.21.15.39:0/541981683 wait complete. 2024-09-13T11:12:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9784072180 msgr2=0x7f9784074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9784072180 0x7f9784074640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f97980113e0 tx=0x7f979800b040 comp rx=0 tx=0).stop 2024-09-13T11:12:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 msgr2=0x7f97a0143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a0143670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f979001fab0 tx=0x7f979001e1a0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 shutdown_connections 2024-09-13T11:12:03.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9784072180 0x7f9784074640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f97a0139cd0 0x7f97a00ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97a0074aa0 0x7f97a0143670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 --2- 172.21.15.39:0/1940708259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00717f0 0x7f97a013c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 >> 172.21.15.39:0/1940708259 conn(0x7f97a00b6330 msgr2=0x7f97a00b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 shutdown_connections 2024-09-13T11:12:03.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.115+0000 7f97a8452640 1 -- 172.21.15.39:0/1940708259 wait complete. 2024-09-13T11:12:03.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-13T11:12:03.131 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-13T11:12:03.141 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-09-13T11:12:03.142 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-13T11:12:03.145 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-13T11:12:03.146 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-13T11:12:03.147 DEBUG:teuthology.parallel:result is None 2024-09-13T11:12:03.147 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T11:12:03.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:12:03.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.291+0000 7f9dd2aa6640 1 Processor -- start 2024-09-13T11:12:03.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.291+0000 7f9dd2aa6640 1 -- start start 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9dcc070270 0x7f9dcc0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 0x7f9dcc074610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc072820 con 0x7f9dcc070650 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9dcc074b50 con 0x7f9dcc070270 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc1477b0 con 0x7f9dcc074180 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 0x7f9dcc074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 0x7f9dcc074610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53552/0 (socket says 172.21.15.39:53552) 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 -- 172.21.15.39:0/3514955305 learned_addr learned my addr 172.21.15.39:0/3514955305 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dcbfff640 1 --1- 172.21.15.39:0/3514955305 >> v1:172.21.15.39:6789/0 conn(0x7f9dcc070650 0x7f9dcc147f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39620/0 (socket says 172.21.15.39:39620) 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd0842640 1 --2- 172.21.15.39:0/3514955305 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc070270 0x7f9dcc0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 -- 172.21.15.39:0/3514955305 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc070270 msgr2=0x7f9dcc0afae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 --2- 172.21.15.39:0/3514955305 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc070270 0x7f9dcc0afae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 -- 172.21.15.39:0/3514955305 >> v1:172.21.15.39:6789/0 conn(0x7f9dcc070650 legacy=0x7f9dcc147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dcb7fe640 1 -- 172.21.15.39:0/3514955305 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043478989 0 0) 0x7f9dcc072820 con 0x7f9dcc070650 2024-09-13T11:12:03.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 -- 172.21.15.39:0/3514955305 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc148630 con 0x7f9dcc074180 2024-09-13T11:12:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd1043640 1 --2- 172.21.15.39:0/3514955305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 0x7f9dcc074610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40098a0 tx=0x7f9dc401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7374f46239074f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dcb7fe640 1 -- 172.21.15.39:0/3514955305 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40b0070 con 0x7f9dcc074180 2024-09-13T11:12:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dcb7fe640 1 -- 172.21.15.39:0/3514955305 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc40ab600 con 0x7f9dcc074180 2024-09-13T11:12:03.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dcb7fe640 1 -- 172.21.15.39:0/3514955305 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40ab9d0 con 0x7f9dcc074180 2024-09-13T11:12:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/3514955305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 msgr2=0x7f9dcc074610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/3514955305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 0x7f9dcc074610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40098a0 tx=0x7f9dc401c400 comp rx=0 tx=0).stop 2024-09-13T11:12:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/3514955305 shutdown_connections 2024-09-13T11:12:03.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/3514955305 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc074180 0x7f9dcc074610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/3514955305 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc070270 0x7f9dcc0afae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/3514955305 >> 172.21.15.39:0/3514955305 conn(0x7f9dcc0b52b0 msgr2=0x7f9dcc0b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/3514955305 shutdown_connections 2024-09-13T11:12:03.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.295+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/3514955305 wait complete. 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 Processor -- start 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- start start 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 0x7f9dcc13f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dcc070650 0x7f9dcc1df750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc074180 0x7f9dcc1dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc154af0 con 0x7f9dcc070650 2024-09-13T11:12:03.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc147a90 con 0x7f9dcc074180 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc154c70 con 0x7f9dcc070270 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 0x7f9dcc13f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 0x7f9dcc13f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53566/0 (socket says 172.21.15.39:53566) 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 -- 172.21.15.39:0/2581349125 learned_addr learned my addr 172.21.15.39:0/2581349125 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dcbfff640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dcc070650 0x7f9dcc1df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 -- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc074180 msgr2=0x7f9dcc1dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc074180 0x7f9dcc1dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 -- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dcc070650 msgr2=0x7f9dcc1df750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dcc070650 0x7f9dcc1df750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 -- 172.21.15.39:0/2581349125 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc140bf0 con 0x7f9dcc070270 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dcbfff640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dcc070650 0x7f9dcc1df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T11:12:03.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd0842640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 0x7f9dcc13f620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9db400d800 tx=0x7f9db400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db400b6c0 con 0x7f9dcc070270 2024-09-13T11:12:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db4019070 con 0x7f9dcc070270 2024-09-13T11:12:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc141140 con 0x7f9dcc070270 2024-09-13T11:12:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db400ba60 con 0x7f9dcc070270 2024-09-13T11:12:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc13fb60 con 0x7f9dcc070270 2024-09-13T11:12:03.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc0afae0 con 0x7f9dcc070270 2024-09-13T11:12:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.299+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f9db400bc00 con 0x7f9dcc070270 2024-09-13T11:12:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.303+0000 7f9dc97fa640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9dac072100 0x7f9dac0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.303+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f9db4092c70 con 0x7f9dcc070270 2024-09-13T11:12:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.303+0000 7f9dcbfff640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9dac072100 0x7f9dac0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.303+0000 7f9dcbfff640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9dac072100 0x7f9dac0745c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc007fd0 tx=0x7f9dbc007f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.307+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9db405e800 con 0x7f9dcc070270 2024-09-13T11:12:03.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.467+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dcc0691c0 con 0x7f9dac072100 2024-09-13T11:12:03.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.467+0000 7f9dc97fa640 1 -- 172.21.15.39:0/2581349125 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35905 (secure 0 0 0) 0x7f9dcc0691c0 con 0x7f9dac072100 2024-09-13T11:12:03.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:12:03.470 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9dac072100 msgr2=0x7f9dac0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9dac072100 0x7f9dac0745c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc007fd0 tx=0x7f9dbc007f40 comp rx=0 tx=0).stop 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 msgr2=0x7f9dcc13f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 0x7f9dcc13f620 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9db400d800 tx=0x7f9db400dcc0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 shutdown_connections 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f9dac072100 0x7f9dac0745c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc074180 0x7f9dcc1dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9dcc070650 0x7f9dcc1df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 --2- 172.21.15.39:0/2581349125 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f9dcc070270 0x7f9dcc13f620 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 >> 172.21.15.39:0/2581349125 conn(0x7f9dcc0b52b0 msgr2=0x7f9dcc0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 shutdown_connections 2024-09-13T11:12:03.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.471+0000 7f9dd2aa6640 1 -- 172.21.15.39:0/2581349125 wait complete. 2024-09-13T11:12:03.488 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T11:12:01.984166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":227248,"kb_used_data":2736,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747472,"statfs":{"total":773094113280,"available":772861411328,"internally_reserved":0,"allocated":2801664,"data_stored":1725350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.866338"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263977+0000","last_change":"2024-09-13T11:11:59.264383+0000","last_active":"2024-09-13T11:11:59.263977+0000","last_peered":"2024-09-13T11:11:59.263977+0000","last_clean":"2024-09-13T11:11:59.263977+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:11:59.263977+0000","last_undegraded":"2024-09-13T11:11:59.263977+0000","last_fullsized":"2024-09-13T11:11:59.263977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:19.549032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.170445+0000","last_change":"2024-09-13T11:11:59.170926+0000","last_active":"2024-09-13T11:11:59.170445+0000","last_peered":"2024-09-13T11:11:59.170445+0000","last_clean":"2024-09-13T11:11:59.170445+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:11:59.170445+0000","last_undegraded":"2024-09-13T11:11:59.170445+0000","last_fullsized":"2024-09-13T11:11:59.170445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:28.792477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263934+0000","last_change":"2024-09-13T11:11:59.264364+0000","last_active":"2024-09-13T11:11:59.263934+0000","last_peered":"2024-09-13T11:11:59.263934+0000","last_clean":"2024-09-13T11:11:59.263934+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:11:59.263934+0000","last_undegraded":"2024-09-13T11:11:59.263934+0000","last_fullsized":"2024-09-13T11:11:59.263934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:46.598343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.170546+0000","last_change":"2024-09-13T11:11:59.171084+0000","last_active":"2024-09-13T11:11:59.170546+0000","last_peered":"2024-09-13T11:11:59.170546+0000","last_clean":"2024-09-13T11:11:59.170546+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:11:59.170546+0000","last_undegraded":"2024-09-13T11:11:59.170546+0000","last_fullsized":"2024-09-13T11:11:59.170546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:01.700221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.177551+0000","last_change":"2024-09-13T11:11:59.177551+0000","last_active":"2024-09-13T11:11:59.177551+0000","last_peered":"2024-09-13T11:11:59.177551+0000","last_clean":"2024-09-13T11:11:59.177551+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:11:59.177551+0000","last_undegraded":"2024-09-13T11:11:59.177551+0000","last_fullsized":"2024-09-13T11:11:59.177551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:06.698959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.262622+0000","last_change":"2024-09-13T11:11:59.262864+0000","last_active":"2024-09-13T11:11:59.262622+0000","last_peered":"2024-09-13T11:11:59.262622+0000","last_clean":"2024-09-13T11:11:59.262622+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:11:59.262622+0000","last_undegraded":"2024-09-13T11:11:59.262622+0000","last_fullsized":"2024-09-13T11:11:59.262622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:49.061602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263854+0000","last_change":"2024-09-13T11:11:59.264363+0000","last_active":"2024-09-13T11:11:59.263854+0000","last_peered":"2024-09-13T11:11:59.263854+0000","last_clean":"2024-09-13T11:11:59.263854+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:11:59.263854+0000","last_undegraded":"2024-09-13T11:11:59.263854+0000","last_fullsized":"2024-09-13T11:11:59.263854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:02.989025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.175111+0000","last_change":"2024-09-13T11:11:59.175526+0000","last_active":"2024-09-13T11:11:59.175111+0000","last_peered":"2024-09-13T11:11:59.175111+0000","last_clean":"2024-09-13T11:11:59.175111+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:11:59.175111+0000","last_undegraded":"2024-09-13T11:11:59.175111+0000","last_fullsized":"2024-09-13T11:11:59.175111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:13.643417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263185+0000","last_change":"2024-09-13T11:11:49.099967+0000","last_active":"2024-09-13T11:11:59.263185+0000","last_peered":"2024-09-13T11:11:59.263185+0000","last_clean":"2024-09-13T11:11:59.263185+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:11:59.263185+0000","last_undegraded":"2024-09-13T11:11:59.263185+0000","last_fullsized":"2024-09-13T11:11:59.263185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_clean_scrub_stamp":"2024-09-13T11:11:48.073845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:02.753349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":658440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":658440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:12:03.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:12:03.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 Processor -- start 2024-09-13T11:12:03.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 -- start start 2024-09-13T11:12:03.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4364068920 0x7f4364073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4364073a60 0x7f4364143490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 0x7f43640ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4364068d00 con 0x7f4364073a60 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4364147390 con 0x7f4364068920 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f436a4d1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4364143e60 con 0x7f43641439d0 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4364073a60 0x7f4364143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f4368a6e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 0x7f43640ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f4368a6e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 0x7f43640ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53568/0 (socket says 172.21.15.39:53568) 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4364073a60 0x7f4364143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53336/0 (socket says 172.21.15.39:53336) 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f4368a6e640 1 -- 172.21.15.39:0/1610673669 learned_addr learned my addr 172.21.15.39:0/1610673669 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f4363fff640 1 --2- 172.21.15.39:0/1610673669 >> v2:172.21.15.102:3300/0 conn(0x7f4364068920 0x7f4364073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.603 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 -- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 msgr2=0x7f43640ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 --2- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 0x7f43640ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 -- 172.21.15.39:0/1610673669 >> v2:172.21.15.102:3300/0 conn(0x7f4364068920 msgr2=0x7f4364073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 --2- 172.21.15.39:0/1610673669 >> v2:172.21.15.102:3300/0 conn(0x7f4364068920 0x7f4364073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 -- 172.21.15.39:0/1610673669 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4364073e80 con 0x7f4364073a60 2024-09-13T11:12:03.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f4368a6e640 1 --2- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 0x7f43640ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f43637fe640 1 --2- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4364073a60 0x7f4364143490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4364068ef0 tx=0x7f435801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce67d49fcbd4ba76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.599+0000 7f4362ffd640 1 -- 172.21.15.39:0/1610673669 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43580b0070 con 0x7f4364073a60 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4362ffd640 1 -- 172.21.15.39:0/1610673669 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43580ab600 con 0x7f4364073a60 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4362ffd640 1 -- 172.21.15.39:0/1610673669 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43580ab9d0 con 0x7f4364073a60 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4364073a60 msgr2=0x7f4364143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4364073a60 0x7f4364143490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4364068ef0 tx=0x7f435801c1a0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/1610673669 shutdown_connections 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f43641439d0 0x7f43640ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- 172.21.15.39:0/1610673669 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4364073a60 0x7f4364143490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- 172.21.15.39:0/1610673669 >> v2:172.21.15.102:3300/0 conn(0x7f4364068920 0x7f4364073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/1610673669 >> 172.21.15.39:0/1610673669 conn(0x7f436406c940 msgr2=0x7f436406cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/1610673669 shutdown_connections 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/1610673669 wait complete. 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 Processor -- start 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- start start 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4364068920 0x7f436413f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4364073a60 0x7f43641df020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43641439d0 0x7f43641db770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f43641470a0 con 0x7f43641439d0 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4364146f20 con 0x7f4364073a60 2024-09-13T11:12:03.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4364147800 con 0x7f4364068920 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4363fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4364068920 0x7f436413f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43641439d0 0x7f43641db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4363fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4364068920 0x7f436413f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53570/0 (socket says 172.21.15.39:53570) 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4363fff640 1 -- 172.21.15.39:0/2275791677 learned_addr learned my addr 172.21.15.39:0/2275791677 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 -- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4364068920 msgr2=0x7f436413f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4364068920 0x7f436413f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 -- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4364073a60 msgr2=0x7f43641df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4364073a60 0x7f43641df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 -- 172.21.15.39:0/2275791677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436414b650 con 0x7f43641439d0 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4368a6e640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43641439d0 0x7f43641db770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f435c009db0 tx=0x7f435c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c00cb20 con 0x7f43641439d0 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c00cce0 con 0x7f43641439d0 2024-09-13T11:12:03.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43641d9100 con 0x7f43641439d0 2024-09-13T11:12:03.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c003be0 con 0x7f43641439d0 2024-09-13T11:12:03.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.603+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43641dbe80 con 0x7f43641439d0 2024-09-13T11:12:03.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.607+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4364143490 con 0x7f43641439d0 2024-09-13T11:12:03.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.607+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f435c01b030 con 0x7f43641439d0 2024-09-13T11:12:03.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.607+0000 7f4360ff9640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4350072100 0x7f43500745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.607+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7f435c092ad0 con 0x7f43641439d0 2024-09-13T11:12:03.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.607+0000 7f4363fff640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4350072100 0x7f43500745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.607+0000 7f4363fff640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4350072100 0x7f43500745c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f435400bb90 tx=0x7f4354008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.611+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f435c022020 con 0x7f43641439d0 2024-09-13T11:12:03.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.775+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43640769e0 con 0x7f4350072100 2024-09-13T11:12:03.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.775+0000 7f4360ff9640 1 -- 172.21.15.39:0/2275791677 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35905 (secure 0 0 0) 0x7f43640769e0 con 0x7f4350072100 2024-09-13T11:12:03.778 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:12:03.779 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4350072100 msgr2=0x7f43500745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4350072100 0x7f43500745c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f435400bb90 tx=0x7f4354008040 comp rx=0 tx=0).stop 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43641439d0 msgr2=0x7f43641db770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43641439d0 0x7f43641db770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f435c009db0 tx=0x7f435c00c490 comp rx=0 tx=0).stop 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 shutdown_connections 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4350072100 0x7f43500745c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f43641439d0 0x7f43641db770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4364073a60 0x7f43641df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 --2- 172.21.15.39:0/2275791677 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4364068920 0x7f436413f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 >> 172.21.15.39:0/2275791677 conn(0x7f436406c940 msgr2=0x7f4364142aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 shutdown_connections 2024-09-13T11:12:03.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.779+0000 7f436a4d1640 1 -- 172.21.15.39:0/2275791677 wait complete. 2024-09-13T11:12:03.796 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T11:12:01.984166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":227248,"kb_used_data":2736,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747472,"statfs":{"total":773094113280,"available":772861411328,"internally_reserved":0,"allocated":2801664,"data_stored":1725350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.866338"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263977+0000","last_change":"2024-09-13T11:11:59.264383+0000","last_active":"2024-09-13T11:11:59.263977+0000","last_peered":"2024-09-13T11:11:59.263977+0000","last_clean":"2024-09-13T11:11:59.263977+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:11:59.263977+0000","last_undegraded":"2024-09-13T11:11:59.263977+0000","last_fullsized":"2024-09-13T11:11:59.263977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:19.549032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.170445+0000","last_change":"2024-09-13T11:11:59.170926+0000","last_active":"2024-09-13T11:11:59.170445+0000","last_peered":"2024-09-13T11:11:59.170445+0000","last_clean":"2024-09-13T11:11:59.170445+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:11:59.170445+0000","last_undegraded":"2024-09-13T11:11:59.170445+0000","last_fullsized":"2024-09-13T11:11:59.170445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:28.792477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263934+0000","last_change":"2024-09-13T11:11:59.264364+0000","last_active":"2024-09-13T11:11:59.263934+0000","last_peered":"2024-09-13T11:11:59.263934+0000","last_clean":"2024-09-13T11:11:59.263934+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:11:59.263934+0000","last_undegraded":"2024-09-13T11:11:59.263934+0000","last_fullsized":"2024-09-13T11:11:59.263934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:46.598343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.170546+0000","last_change":"2024-09-13T11:11:59.171084+0000","last_active":"2024-09-13T11:11:59.170546+0000","last_peered":"2024-09-13T11:11:59.170546+0000","last_clean":"2024-09-13T11:11:59.170546+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:11:59.170546+0000","last_undegraded":"2024-09-13T11:11:59.170546+0000","last_fullsized":"2024-09-13T11:11:59.170546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:01.700221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.177551+0000","last_change":"2024-09-13T11:11:59.177551+0000","last_active":"2024-09-13T11:11:59.177551+0000","last_peered":"2024-09-13T11:11:59.177551+0000","last_clean":"2024-09-13T11:11:59.177551+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:11:59.177551+0000","last_undegraded":"2024-09-13T11:11:59.177551+0000","last_fullsized":"2024-09-13T11:11:59.177551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:06.698959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.262622+0000","last_change":"2024-09-13T11:11:59.262864+0000","last_active":"2024-09-13T11:11:59.262622+0000","last_peered":"2024-09-13T11:11:59.262622+0000","last_clean":"2024-09-13T11:11:59.262622+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:11:59.262622+0000","last_undegraded":"2024-09-13T11:11:59.262622+0000","last_fullsized":"2024-09-13T11:11:59.262622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:49.061602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263854+0000","last_change":"2024-09-13T11:11:59.264363+0000","last_active":"2024-09-13T11:11:59.263854+0000","last_peered":"2024-09-13T11:11:59.263854+0000","last_clean":"2024-09-13T11:11:59.263854+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:11:59.263854+0000","last_undegraded":"2024-09-13T11:11:59.263854+0000","last_fullsized":"2024-09-13T11:11:59.263854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:02.989025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.175111+0000","last_change":"2024-09-13T11:11:59.175526+0000","last_active":"2024-09-13T11:11:59.175111+0000","last_peered":"2024-09-13T11:11:59.175111+0000","last_clean":"2024-09-13T11:11:59.175111+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:11:59.175111+0000","last_undegraded":"2024-09-13T11:11:59.175111+0000","last_fullsized":"2024-09-13T11:11:59.175111+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:13.643417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T11:11:59.263185+0000","last_change":"2024-09-13T11:11:49.099967+0000","last_active":"2024-09-13T11:11:59.263185+0000","last_peered":"2024-09-13T11:11:59.263185+0000","last_clean":"2024-09-13T11:11:59.263185+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:11:59.263185+0000","last_undegraded":"2024-09-13T11:11:59.263185+0000","last_fullsized":"2024-09-13T11:11:59.263185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_clean_scrub_stamp":"2024-09-13T11:11:48.073845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:02.753349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":658440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":200704,"data_stored":68072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":794624,"data_stored":658440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:12:03.797 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T11:12:03.797 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T11:12:03.797 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T11:12:03.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T11:12:03.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 Processor -- start 2024-09-13T11:12:03.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 -- start start 2024-09-13T11:12:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa16c0af1d0 0x7fa16c140260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa16c1407a0 0x7fa16c140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa16c0b0680 con 0x7fa16c0b1c10 2024-09-13T11:12:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa16c141130 con 0x7fa16c1407a0 2024-09-13T11:12:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa170e23640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa16c0aed40 con 0x7fa16c0af1d0 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa16ad9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa16c1407a0 0x7fa16c140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa16ad9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa16c1407a0 0x7fa16c140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53348/0 (socket says 172.21.15.39:53348) 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.903+0000 7fa16ad9d640 1 -- 172.21.15.39:0/2228731431 learned_addr learned my addr 172.21.15.39:0/2228731431 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa169d9b640 1 --2- 172.21.15.39:0/2228731431 >> v2:172.21.15.102:3300/0 conn(0x7fa16c0af1d0 0x7fa16c140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16ad9d640 1 -- 172.21.15.39:0/2228731431 >> v2:172.21.15.102:3300/0 conn(0x7fa16c0af1d0 msgr2=0x7fa16c140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16ad9d640 1 --2- 172.21.15.39:0/2228731431 >> v2:172.21.15.102:3300/0 conn(0x7fa16c0af1d0 0x7fa16c140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16ad9d640 1 -- 172.21.15.39:0/2228731431 >> v1:172.21.15.102:6789/0 conn(0x7fa16c0b1c10 legacy=0x7fa16c146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16ad9d640 1 -- 172.21.15.39:0/2228731431 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c0af5e0 con 0x7fa16c1407a0 2024-09-13T11:12:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16ad9d640 1 --2- 172.21.15.39:0/2228731431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c1407a0 0x7fa16c140bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa16c069730 tx=0x7fa16401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a046b8e98513a197 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16959a640 1 -- 172.21.15.39:0/2228731431 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1640a57a0 con 0x7fa16c1407a0 2024-09-13T11:12:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16959a640 1 -- 172.21.15.39:0/2228731431 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1640a5940 con 0x7fa16c1407a0 2024-09-13T11:12:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa16959a640 1 -- 172.21.15.39:0/2228731431 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1640a5d10 con 0x7fa16c1407a0 2024-09-13T11:12:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 -- 172.21.15.39:0/2228731431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c1407a0 msgr2=0x7fa16c140bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 --2- 172.21.15.39:0/2228731431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c1407a0 0x7fa16c140bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa16c069730 tx=0x7fa16401c940 comp rx=0 tx=0).stop 2024-09-13T11:12:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 -- 172.21.15.39:0/2228731431 shutdown_connections 2024-09-13T11:12:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 --2- 172.21.15.39:0/2228731431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c1407a0 0x7fa16c140bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 --2- 172.21.15.39:0/2228731431 >> v2:172.21.15.102:3300/0 conn(0x7fa16c0af1d0 0x7fa16c140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 -- 172.21.15.39:0/2228731431 >> 172.21.15.39:0/2228731431 conn(0x7fa16c0b2aa0 msgr2=0x7fa16c0b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 -- 172.21.15.39:0/2228731431 shutdown_connections 2024-09-13T11:12:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.907+0000 7fa170e23640 1 -- 172.21.15.39:0/2228731431 wait complete. 2024-09-13T11:12:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 Processor -- start 2024-09-13T11:12:03.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- start start 2024-09-13T11:12:03.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 0x7fa16c148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0b1c10 0x7fa16c1de7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa16c1407a0 0x7fa16c1ded10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c0b2740 con 0x7fa16c0b1c10 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa16c0b25c0 con 0x7fa16c1407a0 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa16c150840 con 0x7fa16c0af1d0 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa169d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0b1c10 0x7fa16c1de7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 0x7fa16c148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 0x7fa16c148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:53584/0 (socket says 172.21.15.39:53584) 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa169d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0b1c10 0x7fa16c1de7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53350/0 (socket says 172.21.15.39:53350) 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 -- 172.21.15.39:0/3688765336 learned_addr learned my addr 172.21.15.39:0/3688765336 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16ad9d640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa16c1407a0 0x7fa16c1ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 -- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa16c1407a0 msgr2=0x7fa16c1ded10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa16c1407a0 0x7fa16c1ded10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 -- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0b1c10 msgr2=0x7fa16c1de7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0b1c10 0x7fa16c1de7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 -- 172.21.15.39:0/3688765336 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16c1496c0 con 0x7fa16c0af1d0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa16a59c640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 0x7fa16c148250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa16000c450 tx=0x7fa16000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160012830 con 0x7fa16c0af1d0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa160017070 con 0x7fa16c0af1d0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16c149a00 con 0x7fa16c0af1d0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160012c30 con 0x7fa16c0af1d0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16c0734b0 con 0x7fa16c0af1d0 2024-09-13T11:12:03.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa16c140260 con 0x7fa16c0af1d0 2024-09-13T11:12:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.911+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fa16001c460 con 0x7fa16c0af1d0 2024-09-13T11:12:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.915+0000 7fa15affd640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa14c072100 0x7fa14c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.915+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fa160092ef0 con 0x7fa16c0af1d0 2024-09-13T11:12:03.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.915+0000 7fa169d9b640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa14c072100 0x7fa14c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:03.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.915+0000 7fa169d9b640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa14c072100 0x7fa14c0745c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa16c148790 tx=0x7fa15c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:03.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:03.915+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa16c149a00 con 0x7fa16c0af1d0 2024-09-13T11:12:04.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa16c0690f0 con 0x7fa16c0af1d0 2024-09-13T11:12:04.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa15affd640 1 -- 172.21.15.39:0/3688765336 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa16005eb60 con 0x7fa16c0af1d0 2024-09-13T11:12:04.120 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:12:04.120 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T11:12:04.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa14c072100 msgr2=0x7fa14c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa14c072100 0x7fa14c0745c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa16c148790 tx=0x7fa15c008040 comp rx=0 tx=0).stop 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 msgr2=0x7fa16c148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 0x7fa16c148250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa16000c450 tx=0x7fa16000c910 comp rx=0 tx=0).stop 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 shutdown_connections 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa14c072100 0x7fa14c0745c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa16c1407a0 0x7fa16c1ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa16c0b1c10 0x7fa16c1de7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 --2- 172.21.15.39:0/3688765336 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa16c0af1d0 0x7fa16c148250 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 >> 172.21.15.39:0/3688765336 conn(0x7fa16c0b2aa0 msgr2=0x7fa16c0b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 shutdown_connections 2024-09-13T11:12:04.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.119+0000 7fa170e23640 1 -- 172.21.15.39:0/3688765336 wait complete. 2024-09-13T11:12:04.138 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T11:12:04.138 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T11:12:04.148 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T11:12:04.148 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:12:04.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool create cephsqlite' 2024-09-13T11:12:04.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 Processor -- start 2024-09-13T11:12:04.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 -- start start 2024-09-13T11:12:04.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa36806d700 0x7fa368140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa368073270 0x7fa368070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3680746c0 con 0x7fa3680af000 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa36806dae0 con 0x7fa368073270 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36f29b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa36806fcd0 con 0x7fa36806d700 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36c836640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa368073270 0x7fa368070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36d838640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa3680af000 0x7fa36813e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39636/0 (socket says 172.21.15.39:39636) 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36d838640 1 -- 172.21.15.39:0/3048471972 learned_addr learned my addr 172.21.15.39:0/3048471972 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36d037640 1 --2- 172.21.15.39:0/3048471972 >> v2:172.21.15.102:3300/0 conn(0x7fa36806d700 0x7fa368140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36c836640 1 -- 172.21.15.39:0/3048471972 >> v2:172.21.15.102:3300/0 conn(0x7fa36806d700 msgr2=0x7fa368140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36c836640 1 --2- 172.21.15.39:0/3048471972 >> v2:172.21.15.102:3300/0 conn(0x7fa36806d700 0x7fa368140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36c836640 1 -- 172.21.15.39:0/3048471972 >> v1:172.21.15.39:6789/0 conn(0x7fa3680af000 legacy=0x7fa36813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:04.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa35ffff640 1 -- 172.21.15.39:0/3048471972 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213524322 0 0) 0x7fa3680746c0 con 0x7fa3680af000 2024-09-13T11:12:04.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.259+0000 7fa36c836640 1 -- 172.21.15.39:0/3048471972 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680706a0 con 0x7fa368073270 2024-09-13T11:12:04.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36c836640 1 --2- 172.21.15.39:0/3048471972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa368073270 0x7fa368070160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa36806a490 tx=0x7fa36401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2834ca4d22c88dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:04.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa35ffff640 1 -- 172.21.15.39:0/3048471972 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640ab680 con 0x7fa368073270 2024-09-13T11:12:04.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa35ffff640 1 -- 172.21.15.39:0/3048471972 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3640b0070 con 0x7fa368073270 2024-09-13T11:12:04.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa35ffff640 1 -- 172.21.15.39:0/3048471972 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640aba40 con 0x7fa368073270 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 -- 172.21.15.39:0/3048471972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa368073270 msgr2=0x7fa368070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 --2- 172.21.15.39:0/3048471972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa368073270 0x7fa368070160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa36806a490 tx=0x7fa36401c460 comp rx=0 tx=0).stop 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 -- 172.21.15.39:0/3048471972 shutdown_connections 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 --2- 172.21.15.39:0/3048471972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa368073270 0x7fa368070160 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 --2- 172.21.15.39:0/3048471972 >> v2:172.21.15.102:3300/0 conn(0x7fa36806d700 0x7fa368140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 -- 172.21.15.39:0/3048471972 >> 172.21.15.39:0/3048471972 conn(0x7fa36806c980 msgr2=0x7fa36806cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 -- 172.21.15.39:0/3048471972 shutdown_connections 2024-09-13T11:12:04.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 -- 172.21.15.39:0/3048471972 wait complete. 2024-09-13T11:12:04.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 Processor -- start 2024-09-13T11:12:04.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.263+0000 7fa36f29b640 1 -- start start 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa36806d700 0x7fa36813b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa368073270 0x7fa3681402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 0x7fa368140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa36814e380 con 0x7fa3680af000 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa36814e200 con 0x7fa368073270 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa36814e500 con 0x7fa36806d700 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 0x7fa368140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d037640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa36806d700 0x7fa36813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:04.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 0x7fa368140820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53374/0 (socket says 172.21.15.39:53374) 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 -- 172.21.15.39:0/631209373 learned_addr learned my addr 172.21.15.39:0/631209373 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36c836640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa368073270 0x7fa3681402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 -- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa36806d700 msgr2=0x7fa36813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa36806d700 0x7fa36813b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 -- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa368073270 msgr2=0x7fa3681402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa368073270 0x7fa3681402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 -- 172.21.15.39:0/631209373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36813aaa0 con 0x7fa3680af000 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d037640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa36806d700 0x7fa36813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36d838640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 0x7fa368140820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa36000c730 tx=0x7fa36000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360018070 con 0x7fa3680af000 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36000ce40 con 0x7fa3680af000 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36813ad10 con 0x7fa3680af000 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36000a860 con 0x7fa3680af000 2024-09-13T11:12:04.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa368133600 con 0x7fa3680af000 2024-09-13T11:12:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa368139c10 con 0x7fa3680af000 2024-09-13T11:12:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.267+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fa36001b070 con 0x7fa3680af000 2024-09-13T11:12:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.271+0000 7fa35dffb640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa34c072100 0x7fa34c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.271+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5266+0+0 (secure 0 0 0) 0x7fa360091ec0 con 0x7fa3680af000 2024-09-13T11:12:04.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.271+0000 7fa36d037640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa34c072100 0x7fa34c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:04.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.271+0000 7fa36d037640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa34c072100 0x7fa34c0745c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa358007db0 tx=0x7fa358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:04.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.271+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa36005d4e0 con 0x7fa3680af000 2024-09-13T11:12:04.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:04.435+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephsqlite"} v 0) -- 0x7fa368140ec0 con 0x7fa3680af000 2024-09-13T11:12:05.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.247+0000 7fa35dffb640 1 -- 172.21.15.39:0/631209373 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephsqlite"}]=0 pool 'cephsqlite' created v21) ==== 110+0+0 (secure 0 0 0) 0x7fa360061ca0 con 0x7fa3680af000 2024-09-13T11:12:05.248 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephsqlite' created 2024-09-13T11:12:05.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa34c072100 msgr2=0x7fa34c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa34c072100 0x7fa34c0745c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa358007db0 tx=0x7fa358008040 comp rx=0 tx=0).stop 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 msgr2=0x7fa368140820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 0x7fa368140820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa36000c730 tx=0x7fa36000cbf0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 shutdown_connections 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa34c072100 0x7fa34c0745c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa3680af000 0x7fa368140820 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa368073270 0x7fa3681402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 --2- 172.21.15.39:0/631209373 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa36806d700 0x7fa36813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 >> 172.21.15.39:0/631209373 conn(0x7fa36806c980 msgr2=0x7fa3681385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 shutdown_connections 2024-09-13T11:12:05.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.251+0000 7fa36f29b640 1 -- 172.21.15.39:0/631209373 wait complete. 2024-09-13T11:12:05.283 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph auth get-or-create client.libcephsqlite mon '"'"'profile simple-rados-client-with-blocklist'"'"' osd '"'"'allow rwx pool=cephsqlite'"'"' >> /etc/ceph/ceph.keyring' 2024-09-13T11:12:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 Processor -- start 2024-09-13T11:12:05.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 -- start start 2024-09-13T11:12:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcf500b6330 0x7fcf50146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf500b5780 0x7fcf50139630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:05.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5013a020 con 0x7fcf50139b70 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fcf500b6710 con 0x7fcf500b5780 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf56f62640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcf50147240 con 0x7fcf500b6330 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf4ffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fcf500b5780 0x7fcf50139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf554ff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcf50139b70 0x7fcf50143200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:39638/0 (socket says 172.21.15.39:39638) 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf554ff640 1 -- 172.21.15.39:0/750171425 learned_addr learned my addr 172.21.15.39:0/750171425 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf54cfe640 1 --2- 172.21.15.39:0/750171425 >> v2:172.21.15.102:3300/0 conn(0x7fcf500b6330 0x7fcf50146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf4ffff640 1 -- 172.21.15.39:0/750171425 >> v2:172.21.15.102:3300/0 conn(0x7fcf500b6330 msgr2=0x7fcf50146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf4ffff640 1 --2- 172.21.15.39:0/750171425 >> v2:172.21.15.102:3300/0 conn(0x7fcf500b6330 0x7fcf50146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf4ffff640 1 -- 172.21.15.39:0/750171425 >> v1:172.21.15.39:6789/0 conn(0x7fcf50139b70 legacy=0x7fcf50143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf4ffff640 1 -- 172.21.15.39:0/750171425 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf50140d40 con 0x7fcf500b5780 2024-09-13T11:12:05.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.419+0000 7fcf4f7fe640 1 -- 172.21.15.39:0/750171425 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841993143 0 0) 0x7fcf5013a020 con 0x7fcf50139b70 2024-09-13T11:12:05.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf4ffff640 1 --2- 172.21.15.39:0/750171425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b5780 0x7fcf50139630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ba100 tx=0x7fcf4401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7b41dee4588214 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf4f7fe640 1 -- 172.21.15.39:0/750171425 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf440ab680 con 0x7fcf500b5780 2024-09-13T11:12:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf4f7fe640 1 -- 172.21.15.39:0/750171425 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf440b0070 con 0x7fcf500b5780 2024-09-13T11:12:05.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf4f7fe640 1 -- 172.21.15.39:0/750171425 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf440aba40 con 0x7fcf500b5780 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 -- 172.21.15.39:0/750171425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b5780 msgr2=0x7fcf50139630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 --2- 172.21.15.39:0/750171425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b5780 0x7fcf50139630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf500ba100 tx=0x7fcf4401c460 comp rx=0 tx=0).stop 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 -- 172.21.15.39:0/750171425 shutdown_connections 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 --2- 172.21.15.39:0/750171425 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b5780 0x7fcf50139630 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 --2- 172.21.15.39:0/750171425 >> v2:172.21.15.102:3300/0 conn(0x7fcf500b6330 0x7fcf50146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 -- 172.21.15.39:0/750171425 >> 172.21.15.39:0/750171425 conn(0x7fcf5006ef80 msgr2=0x7fcf5006f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 -- 172.21.15.39:0/750171425 shutdown_connections 2024-09-13T11:12:05.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 -- 172.21.15.39:0/750171425 wait complete. 2024-09-13T11:12:05.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 Processor -- start 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.423+0000 7fcf56f62640 1 -- start start 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 0x7fcf5014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf50139b70 0x7fcf5014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf50148b30 0x7fcf501dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcf50150720 con 0x7fcf500b6330 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501505a0 con 0x7fcf50139b70 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fcf501508a0 con 0x7fcf50148b30 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf54cfe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 0x7fcf5014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf50148b30 0x7fcf501dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf54cfe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 0x7fcf5014b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53396/0 (socket says 172.21.15.39:53396) 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf54cfe640 1 -- 172.21.15.39:0/762631411 learned_addr learned my addr 172.21.15.39:0/762631411 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4ffff640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf50139b70 0x7fcf5014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:05.429 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 -- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf50139b70 msgr2=0x7fcf5014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf50139b70 0x7fcf5014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 -- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 msgr2=0x7fcf5014b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 0x7fcf5014b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 -- 172.21.15.39:0/762631411 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5014d060 con 0x7fcf50148b30 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf54cfe640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 0x7fcf5014b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf554ff640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf50148b30 0x7fcf501dea40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c730 tx=0x7fcf4800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48018070 con 0x7fcf50148b30 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf48004d90 con 0x7fcf50148b30 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800a880 con 0x7fcf50148b30 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5014d340 con 0x7fcf50148b30 2024-09-13T11:12:05.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5014c1b0 con 0x7fcf50148b30 2024-09-13T11:12:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5014c6d0 con 0x7fcf50148b30 2024-09-13T11:12:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fcf4801b070 con 0x7fcf50148b30 2024-09-13T11:12:05.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4d7fa640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fcf3c072100 0x7fcf3c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:12:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5587+0+0 (secure 0 0 0) 0x7fcf48091f20 con 0x7fcf50148b30 2024-09-13T11:12:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.427+0000 7fcf54cfe640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fcf3c072100 0x7fcf3c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:12:05.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.431+0000 7fcf54cfe640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fcf3c072100 0x7fcf3c0745c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007f00 tx=0x7fcf40008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:12:05.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.431+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fcf4805d320 con 0x7fcf50148b30 2024-09-13T11:12:05.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.667+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]} v 0) -- 0x7fcf500ac140 con 0x7fcf50148b30 2024-09-13T11:12:05.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf4d7fa640 1 -- 172.21.15.39:0/762631411 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]}]=0 v4) ==== 199+0+71 (secure 0 0 0) 0x7fcf48061ae0 con 0x7fcf50148b30 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fcf3c072100 msgr2=0x7fcf3c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fcf3c072100 0x7fcf3c0745c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf40007f00 tx=0x7fcf40008040 comp rx=0 tx=0).stop 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf50148b30 msgr2=0x7fcf501dea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf50148b30 0x7fcf501dea40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c730 tx=0x7fcf4800cbf0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 shutdown_connections 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fcf3c072100 0x7fcf3c0745c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fcf50148b30 0x7fcf501dea40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf50139b70 0x7fcf5014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 --2- 172.21.15.39:0/762631411 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500b6330 0x7fcf5014b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:12:05.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 >> 172.21.15.39:0/762631411 conn(0x7fcf5006ef80 msgr2=0x7fcf500aac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:12:05.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.679+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 shutdown_connections 2024-09-13T11:12:05.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:12:05.683+0000 7fcf56f62640 1 -- 172.21.15.39:0/762631411 wait complete. 2024-09-13T11:12:05.705 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T11:12:05.715 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T11:12:05.716 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:12:05.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr' 2024-09-13T11:12:05.749 INFO:teuthology.orchestra.run.smithi039.stdout:[==========] Running 20 tests from 1 test suite. 2024-09-13T11:12:05.750 INFO:teuthology.orchestra.run.smithi039.stdout:[----------] Global test environment set-up. 2024-09-13T11:12:05.750 INFO:teuthology.orchestra.run.smithi039.stdout:[----------] 20 tests from CephSQLiteTest 2024-09-13T11:12:10.757 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.Create 2024-09-13T11:12:10.772 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/d41dbbbc-40a3-4e3f-a823-c2398524c8e7.db?vfs=ceph 2024-09-13T11:12:10.772 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:10.781 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a INT); 2024-09-13T11:12:10.808 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.Create (51 ms) 2024-09-13T11:12:10.808 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertBulk4096 2024-09-13T11:12:10.824 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/ebf44fa7-f4e6-4a24-94ae-2212b836577d.db?vfs=ceph 2024-09-13T11:12:10.824 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:10.831 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA page_size = 4096;CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000;PRAGMA page_size; 2024-09-13T11:12:14.009 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertBulk4096 (3201 ms) 2024-09-13T11:12:14.009 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertBulk 2024-09-13T11:12:14.023 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/f611b679-2268-4b5a-8110-0697ab2831e9.db?vfs=ceph 2024-09-13T11:12:14.023 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:14.031 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000; 2024-09-13T11:12:14.644 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertBulk (635 ms) 2024-09-13T11:12:14.644 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.UpdateBulk 2024-09-13T11:12:14.657 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/639db275-1b28-441a-a857-73c390b3cacf.db?vfs=ceph 2024-09-13T11:12:14.657 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:14.664 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;SELECT SUM(a) FROM foo;UPDATE foo SET a = a+a;SELECT SUM(a) FROM foo; 2024-09-13T11:12:16.117 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.UpdateBulk (1472 ms) 2024-09-13T11:12:16.117 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertRate 2024-09-13T11:12:16.129 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/2b1b0569-400b-4bbd-b216-23095e59072f.db?vfs=ceph 2024-09-13T11:12:16.129 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:16.137 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-13T11:12:21.202 INFO:teuthology.orchestra.run.smithi039.stdout:transactions per second: 19.8429 2024-09-13T11:12:21.203 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertRate (5087 ms) 2024-09-13T11:12:21.204 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.DatabaseShrink 2024-09-13T11:12:21.218 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/c3380bec-fda9-49b0-bb39-c4aca0c4a52c.db?vfs=ceph 2024-09-13T11:12:21.218 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:21.226 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%4 < 3;VACUUM; 2024-09-13T11:12:23.535 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.DatabaseShrink (2330 ms) 2024-09-13T11:12:23.535 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveRate 2024-09-13T11:12:23.550 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/a29249ad-18c6-4181-b4d1-90f7db61dcca.db?vfs=ceph 2024-09-13T11:12:23.550 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:23.555 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-13T11:12:25.624 INFO:teuthology.orchestra.run.smithi039.stdout:transactions per second: 48.8316 2024-09-13T11:12:25.628 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertExclusiveRate (2094 ms) 2024-09-13T11:12:25.628 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveWALRate 2024-09-13T11:12:25.642 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/c087d4cb-07c7-4817-9b38-76107911c3f4.db?vfs=ceph 2024-09-13T11:12:25.642 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:25.648 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-13T11:12:26.522 INFO:teuthology.orchestra.run.smithi039.stdout:transactions per second: 125.008 2024-09-13T11:12:26.568 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertExclusiveWALRate (940 ms) 2024-09-13T11:12:26.568 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.WALTransactionSync 2024-09-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/b4eeea2f-8a1d-4fc4-9096-ca83451cf191.db?vfs=ceph 2024-09-13T11:12:26.584 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:26.591 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO perf (v) VALUES (ceph_perf());BEGIN TRANSACTION;INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-09-13T11:12:26.700 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.WALTransactionSync (132 ms) 2024-09-13T11:12:26.700 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.PersistTransactionSync 2024-09-13T11:12:26.712 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/db16724f-f6c1-4c64-b37c-faaecbcf1afe.db?vfs=ceph 2024-09-13T11:12:26.712 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:26.716 INFO:teuthology.orchestra.run.smithi039.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-09-13T11:12:26.744 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.PersistTransactionSync (44 ms) 2024-09-13T11:12:26.744 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveLock 2024-09-13T11:12:26.757 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/da6c1b1f-5f68-492b-b6ac-41d3569ff96b.db?vfs=ceph 2024-09-13T11:12:26.757 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:26.765 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount';SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.lock' AND b.fullkey = '$.libcephsqlite_striper.lock'; 2024-09-13T11:12:26.814 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertExclusiveLock (70 ms) 2024-09-13T11:12:26.814 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.TransactionSizeUpdate 2024-09-13T11:12:26.827 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/3c333a90-ead6-40ba-81cb-6e4c44841eaa.db?vfs=ceph 2024-09-13T11:12:26.828 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:26.834 INFO:teuthology.orchestra.run.smithi039.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_size' AND b.fullkey = '$.libcephsqlite_striper.update_size'; 2024-09-13T11:12:26.876 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.TransactionSizeUpdate (61 ms) 2024-09-13T11:12:26.876 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.AllocatedGrowth 2024-09-13T11:12:26.892 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/9142c051-6fc2-409e-ad83-81a1e3150fcb.db?vfs=ceph 2024-09-13T11:12:26.892 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:26.900 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_allocated' AND b.fullkey = '$.libcephsqlite_striper.update_allocated'; 2024-09-13T11:12:34.172 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.AllocatedGrowth (7296 ms) 2024-09-13T11:12:34.172 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.DeleteBulk 2024-09-13T11:12:34.180 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/88a8a418-315b-400b-8d33-f08ffc6dc5a5.db?vfs=ceph 2024-09-13T11:12:34.180 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:34.184 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%2 == 0; 2024-09-13T11:12:35.587 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.DeleteBulk (1415 ms) 2024-09-13T11:12:35.587 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.DropMassive 2024-09-13T11:12:35.596 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/0d7b28b9-8970-4173-863a-24e816876877.db?vfs=ceph 2024-09-13T11:12:35.597 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:12:35.601 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;DROP TABLE foo;VACUUM;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink' AND b.fullkey = '$.libcephsqlite_striper.shrink';SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink_bytes' AND b.fullkey = '$.libcephsqlite_striper.shrink_bytes'; 2024-09-13T11:13:16.093 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.DropMassive (40505 ms) 2024-09-13T11:13:16.094 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.InsertMassiveVerify 2024-09-13T11:13:16.105 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/b3305738-4f8e-47a5-945d-fc81ea28d4d4.db?vfs=ceph 2024-09-13T11:13:16.105 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:13:16.112 INFO:teuthology.orchestra.run.smithi039.stdout:CREATE TABLE foo (a BLOB);CREATE TEMPORARY TABLE bar (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO bar (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;SELECT a FROM bar;INSERT INTO foo (a) SELECT a FROM bar;SELECT a FROM foo; 2024-09-13T11:13:30.241 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.InsertMassiveVerify (14148 ms) 2024-09-13T11:13:30.241 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.PerfValid 2024-09-13T11:13:30.255 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/dd4a38bc-e1dd-4f92-8fbc-461a8471bf81.db?vfs=ceph 2024-09-13T11:13:30.255 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:13:30.266 INFO:teuthology.orchestra.run.smithi039.stdout:SELECT json_valid(ceph_perf()); 2024-09-13T11:13:30.266 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.PerfValid (26 ms) 2024-09-13T11:13:30.267 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.StatusValid 2024-09-13T11:13:30.280 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/301782cc-87e9-4fc9-a5f7-8bd853f47ddf.db?vfs=ceph 2024-09-13T11:13:30.280 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:13:30.291 INFO:teuthology.orchestra.run.smithi039.stdout:SELECT json_valid(ceph_status()); 2024-09-13T11:13:30.291 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.StatusValid (25 ms) 2024-09-13T11:13:30.291 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.CurrentTime 2024-09-13T11:13:30.301 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/b562f095-821b-421a-b219-f3df9291eb7a.db?vfs=ceph 2024-09-13T11:13:30.301 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:13:30.306 INFO:teuthology.orchestra.run.smithi039.stdout:SELECT strftime('%s', 'now'); 2024-09-13T11:13:30.307 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.CurrentTime (16 ms) 2024-09-13T11:13:30.307 INFO:teuthology.orchestra.run.smithi039.stdout:[ RUN ] CephSQLiteTest.StatusFields 2024-09-13T11:13:30.318 INFO:teuthology.orchestra.run.smithi039.stdout:using database: file:cephsqlite:/a5f7f428-2f41-4b5c-b473-4ae6839f295f.db?vfs=ceph 2024-09-13T11:13:30.318 INFO:teuthology.orchestra.run.smithi039.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:SELECT json_extract(ceph_status(), '$.addr');SELECT json_extract(ceph_status(), '$.id'); 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2729689992 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:4446 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:[ OK ] CephSQLiteTest.StatusFields (19 ms) 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:[----------] 20 tests from CephSQLiteTest (79567 ms total) 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:[----------] Global test environment tear-down 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:[==========] 20 tests from 1 test suite ran. (84575 ms total) 2024-09-13T11:13:30.327 INFO:teuthology.orchestra.run.smithi039.stdout:[ PASSED ] 20 tests. 2024-09-13T11:13:30.370 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T11:13:30.387 INFO:tasks.workunit:Pulling workunits from ref d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T11:13:30.388 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T11:13:30.388 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T11:13:30.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:13:30.418 INFO:teuthology.orchestra.run.smithi039.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-13T11:13:30.418 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-13T11:13:30.465 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-13T11:13:30.465 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-13T11:13:30.517 INFO:tasks.workunit:timeout=3h 2024-09-13T11:13:30.518 INFO:tasks.workunit:cleanup=True 2024-09-13T11:13:30.518 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d58f73069a8157a9ace12a0247ee3e8497707ea9 2024-09-13T11:13:30.567 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T11:14:28.526 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 94% (12051/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T11:14:29.263 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to 'd58f73069a8157a9ace12a0247ee3e8497707ea9'. 2024-09-13T11:14:29.263 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.263 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T11:14:29.263 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.264 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T11:14:29.265 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:29.265 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at d58f73069a8 tools/ceph-bluestore-tool: Added zap-device documentation 2024-09-13T11:14:29.270 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T11:14:29.318 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T11:14:29.322 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T11:14:29.322 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T11:14:30.103 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T11:14:30.193 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T11:14:30.245 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T11:14:30.247 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T11:14:30.247 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T11:14:30.295 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T11:14:30.299 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-09-13T11:14:30.299 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T11:14:30.350 INFO:tasks.workunit:Running workunits matching rados/test_libcephsqlite.sh on client.0... 2024-09-13T11:14:30.351 INFO:tasks.workunit:Running workunit rados/test_libcephsqlite.sh... 2024-09-13T11:14:30.351 DEBUG:teuthology.orchestra.run.smithi039:workunit test rados/test_libcephsqlite.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d58f73069a8157a9ace12a0247ee3e8497707ea9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CEPH_ARGS='--id libcephsqlite --no-log-to-stderr' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh cephsqlite 2024-09-13T11:14:30.403 INFO:tasks.workunit.client.0.smithi039.stderr:+ pool=cephsqlite 2024-09-13T11:14:30.404 INFO:tasks.workunit.client.0.smithi039.stderr:++ basename /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh 2024-09-13T11:14:30.404 INFO:tasks.workunit.client.0.smithi039.stderr:+ ns=test_libcephsqlite.sh 2024-09-13T11:14:30.405 INFO:tasks.workunit.client.0.smithi039.stderr:+ striper rm baz.db 2024-09-13T11:14:30.405 INFO:tasks.workunit.client.0.smithi039.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-13T11:14:30.465 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite 2024-09-13T11:14:30.466 INFO:tasks.workunit.client.0.smithi039.stderr:+ background= 2024-09-13T11:14:30.466 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' '' = b ']' 2024-09-13T11:14:30.466 INFO:tasks.workunit.client.0.smithi039.stderr:++ cat 2024-09-13T11:14:30.466 INFO:tasks.workunit.client.0.smithi039.stderr:+ a='create table if not exists foo (a INT); 2024-09-13T11:14:30.466 INFO:tasks.workunit.client.0.smithi039.stderr:insert into foo (a) values (RANDOM()); 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:drop table foo;' 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:+ printf %s 'create table if not exists foo (a INT); 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:insert into foo (a) values (RANDOM()); 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:drop table foo;' 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:create table if not exists foo (a INT); 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:insert into foo (a) values (RANDOM()); 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:drop table foo;+ '[' '' '!=' b ']' 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:+ wait 2024-09-13T11:14:30.467 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:14:30.842 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:30.842 INFO:tasks.workunit.client.0.smithi039.stderr:real 0m0.377s 2024-09-13T11:14:30.842 INFO:tasks.workunit.client.0.smithi039.stderr:user 0m0.055s 2024-09-13T11:14:30.843 INFO:tasks.workunit.client.0.smithi039.stderr:sys 0m0.040s 2024-09-13T11:14:30.843 INFO:tasks.workunit.client.0.smithi039.stderr:+ striper stat baz.db 2024-09-13T11:14:30.843 INFO:tasks.workunit.client.0.smithi039.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper stat baz.db 2024-09-13T11:14:30.890 INFO:tasks.workunit.client.0.smithi039.stdout:cephsqlite/baz.db mtime 2024-09-13T11:14:30.000000+0000, size 8192 2024-09-13T11:14:30.894 INFO:tasks.workunit.client.0.smithi039.stderr:+ striper rm baz.db 2024-09-13T11:14:30.894 INFO:tasks.workunit.client.0.smithi039.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-13T11:14:30.946 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite 2024-09-13T11:14:30.946 INFO:tasks.workunit.client.0.smithi039.stderr:++ repeat 10 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ n=10 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ shift 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i = 0 )) 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.947 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.948 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 10 )) 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:+ background= 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' '' = b ']' 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:++ cat 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:+ a='CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-13T11:14:30.949 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT LENGTH(text) FROM rand; 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:DROP TABLE rand;' 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:+ printf %s 'CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.950 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT LENGTH(text) FROM rand; 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:DROP TABLE rand;' 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.951 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT LENGTH(text) FROM rand; 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:+ wait 2024-09-13T11:14:30.952 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.191 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.454 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:32.454 INFO:tasks.workunit.client.0.smithi039.stderr:real 0m1.509s 2024-09-13T11:14:32.454 INFO:tasks.workunit.client.0.smithi039.stderr:user 0m0.192s 2024-09-13T11:14:32.454 INFO:tasks.workunit.client.0.smithi039.stderr:sys 0m0.075s 2024-09-13T11:14:32.454 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ repeat 100 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ n=100 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ shift 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i = 0 )) 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.473 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.474 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.475 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.476 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.477 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.478 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.479 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.480 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.481 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.482 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.483 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.484 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.485 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.486 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.487 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.488 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.489 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.490 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.491 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.492 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.493 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.494 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.495 INFO:tasks.workunit.client.0.smithi039.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( ++i )) 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:++ (( i < 100 )) 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:+ background= 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' '' = b ']' 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:++ cat 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:+ a='BEGIN TRANSACTION; 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.496 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.497 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.498 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.499 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.500 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.501 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.502 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.503 INFO:tasks.workunit.client.0.smithi039.stderr:COMMIT; 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT LENGTH(text) FROM rand; 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:DROP TABLE rand;' 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:+ printf %s 'BEGIN TRANSACTION; 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.504 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.505 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.506 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.507 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.508 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.509 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.510 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:COMMIT; 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT LENGTH(text) FROM rand; 2024-09-13T11:14:32.511 INFO:tasks.workunit.client.0.smithi039.stderr:DROP TABLE rand;' 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:BEGIN TRANSACTION; 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.512 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.513 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.514 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.515 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.516 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.517 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.518 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:COMMIT; 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT LENGTH(text) FROM rand; 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:+ wait 2024-09-13T11:14:32.519 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.972 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.973 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.974 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.975 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.976 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.977 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.978 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:32.979 INFO:tasks.workunit.client.0.smithi039.stdout:4096 2024-09-13T11:14:35.102 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-09-13T11:14:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:real 0m2.649s 2024-09-13T11:14:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:user 0m0.141s 2024-09-13T11:14:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:sys 0m0.130s 2024-09-13T11:14:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:+ striper rm baz.db 2024-09-13T11:14:35.103 INFO:tasks.workunit.client.0.smithi039.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-13T11:14:35.162 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:14:35.162 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:14:35 AM UTC 2024 2024-09-13T11:14:35.163 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite b 2024-09-13T11:14:35.163 INFO:tasks.workunit.client.0.smithi039.stderr:+ background=b 2024-09-13T11:14:35.163 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' b = b ']' 2024-09-13T11:14:35.163 INFO:tasks.workunit.client.0.smithi039.stderr:+ shift 2024-09-13T11:14:35.163 INFO:tasks.workunit.client.0.smithi039.stderr:++ cat 2024-09-13T11:14:35.164 INFO:tasks.workunit.client.0.smithi039.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-09-13T11:14:35.164 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo VALUES ("start"); 2024-09-13T11:14:35.164 INFO:tasks.workunit.client.0.smithi039.stderr:WITH RECURSIVE c(x) AS 2024-09-13T11:14:35.164 INFO:tasks.workunit.client.0.smithi039.stderr: ( 2024-09-13T11:14:35.164 INFO:tasks.workunit.client.0.smithi039.stderr: VALUES(1) 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: UNION ALL 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT x+1 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: ) 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo (a) 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: LIMIT (1<<20);' 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo VALUES ("start"); 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr:WITH RECURSIVE c(x) AS 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: ( 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: VALUES(1) 2024-09-13T11:14:35.165 INFO:tasks.workunit.client.0.smithi039.stderr: UNION ALL 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT x+1 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: ) 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo (a) 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: LIMIT (1<<20);' 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr:CREATE TABLE foo (a BLOB); 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo VALUES ("start"); 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr:WITH RECURSIVE c(x) AS 2024-09-13T11:14:35.166 INFO:tasks.workunit.client.0.smithi039.stderr: ( 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: VALUES(1) 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: UNION ALL 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT x+1 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: ) 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo (a) 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr:+ sleep 10 2024-09-13T11:14:35.167 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:14:45.165 INFO:tasks.workunit.client.0.smithi039.stdout:done 2024-09-13T11:14:45.165 INFO:tasks.workunit.client.0.smithi039.stderr:+ echo done 2024-09-13T11:14:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:+ jobs -l 2024-09-13T11:14:45.166 INFO:tasks.workunit.client.0.smithi039.stdout:[1]+ 31963 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-09-13T11:14:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:++ jobs -p 2024-09-13T11:14:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:+ kill -KILL -- 31963 2024-09-13T11:14:45.166 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:14:45.167 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:14:45 AM UTC 2024 2024-09-13T11:14:45.167 INFO:tasks.workunit.client.0.smithi039.stderr:+ wait 2024-09-13T11:14:45.169 INFO:tasks.workunit.client.0.smithi039.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 95: 31963 Killed sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" 2024-09-13T11:14:45.169 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:14:45.170 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:14:45 AM UTC 2024 2024-09-13T11:14:45.171 INFO:tasks.workunit.client.0.smithi039.stderr:++ sqlite 2024-09-13T11:14:45.171 INFO:tasks.workunit.client.0.smithi039.stderr:++ background= 2024-09-13T11:14:45.171 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' '' = b ']' 2024-09-13T11:14:45.171 INFO:tasks.workunit.client.0.smithi039.stderr:+++ cat 2024-09-13T11:14:45.172 INFO:tasks.workunit.client.0.smithi039.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-09-13T11:14:45.172 INFO:tasks.workunit.client.0.smithi039.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-09-13T11:14:45.172 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-09-13T11:14:45.172 INFO:tasks.workunit.client.0.smithi039.stderr:++ wait 2024-09-13T11:14:45.172 INFO:tasks.workunit.client.0.smithi039.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:15:13.460 INFO:tasks.workunit.client.0.smithi039.stderr:+ n=1 2024-09-13T11:15:13.460 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' 1 -eq 1 ']' 2024-09-13T11:15:13.460 INFO:tasks.workunit.client.0.smithi039.stderr:+ striper rm baz.db 2024-09-13T11:15:13.460 INFO:tasks.workunit.client.0.smithi039.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-13T11:15:13.523 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:15:13.524 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:15:13 AM UTC 2024 2024-09-13T11:15:13.524 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite b 2024-09-13T11:15:13.524 INFO:tasks.workunit.client.0.smithi039.stderr:+ background=b 2024-09-13T11:15:13.524 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' b = b ']' 2024-09-13T11:15:13.525 INFO:tasks.workunit.client.0.smithi039.stderr:+ shift 2024-09-13T11:15:13.525 INFO:tasks.workunit.client.0.smithi039.stderr:++ cat 2024-09-13T11:15:13.525 INFO:tasks.workunit.client.0.smithi039.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-09-13T11:15:13.525 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo VALUES ("start"); 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr:WITH RECURSIVE c(x) AS 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: ( 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: VALUES(1) 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: UNION ALL 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT x+1 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: ) 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo (a) 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr: LIMIT (1<<20);' 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-09-13T11:15:13.526 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo VALUES ("start"); 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr:WITH RECURSIVE c(x) AS 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: ( 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: VALUES(1) 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: UNION ALL 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT x+1 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: ) 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo (a) 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr: LIMIT (1<<20);' 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr:CREATE TABLE foo (a BLOB); 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo VALUES ("start"); 2024-09-13T11:15:13.527 INFO:tasks.workunit.client.0.smithi039.stderr:WITH RECURSIVE c(x) AS 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: ( 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: VALUES(1) 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: UNION ALL 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT x+1 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: ) 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr:INSERT INTO foo (a) 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: FROM c 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr:+ sleep 20 2024-09-13T11:15:13.528 INFO:tasks.workunit.client.0.smithi039.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:15:33.526 INFO:tasks.workunit.client.0.smithi039.stdout:[1]+ 32034 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-09-13T11:15:33.527 INFO:tasks.workunit.client.0.smithi039.stderr:+ jobs -l 2024-09-13T11:15:33.527 INFO:tasks.workunit.client.0.smithi039.stderr:++ jobs -p 2024-09-13T11:15:33.528 INFO:tasks.workunit.client.0.smithi039.stderr:+ kill -STOP -- 32034 2024-09-13T11:15:33.528 INFO:tasks.workunit.client.0.smithi039.stderr:+ sleep 45 2024-09-13T11:16:18.528 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:16:18.529 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:16:18 AM UTC 2024 2024-09-13T11:16:18.530 INFO:tasks.workunit.client.0.smithi039.stderr:++ jobs -p 2024-09-13T11:16:18.530 INFO:tasks.workunit.client.0.smithi039.stderr:+ kill -CONT -- 32034 2024-09-13T11:16:18.530 INFO:tasks.workunit.client.0.smithi039.stderr:+ sleep 10 2024-09-13T11:16:18.562 INFO:tasks.workunit.client.0.smithi039.stderr:Error: near line 3: stepping, disk I/O error (10) 2024-09-13T11:16:28.531 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:16:28.532 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:16:28 AM UTC 2024 2024-09-13T11:16:28.533 INFO:tasks.workunit.client.0.smithi039.stderr:+ wait 2024-09-13T11:16:28.533 INFO:tasks.workunit.client.0.smithi039.stderr:+ date 2024-09-13T11:16:28.534 INFO:tasks.workunit.client.0.smithi039.stdout:Fri Sep 13 11:16:28 AM UTC 2024 2024-09-13T11:16:28.535 INFO:tasks.workunit.client.0.smithi039.stderr:++ sqlite 2024-09-13T11:16:28.535 INFO:tasks.workunit.client.0.smithi039.stderr:++ background= 2024-09-13T11:16:28.535 INFO:tasks.workunit.client.0.smithi039.stderr:++ '[' '' = b ']' 2024-09-13T11:16:28.535 INFO:tasks.workunit.client.0.smithi039.stderr:+++ cat 2024-09-13T11:16:28.537 INFO:tasks.workunit.client.0.smithi039.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-09-13T11:16:28.537 INFO:tasks.workunit.client.0.smithi039.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-09-13T11:16:28.537 INFO:tasks.workunit.client.0.smithi039.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-09-13T11:16:28.537 INFO:tasks.workunit.client.0.smithi039.stderr:++ wait 2024-09-13T11:16:28.537 INFO:tasks.workunit.client.0.smithi039.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-13T11:16:29.295 INFO:tasks.workunit.client.0.smithi039.stderr:+ n=1 2024-09-13T11:16:29.296 INFO:tasks.workunit.client.0.smithi039.stderr:+ '[' 1 -eq 1 ']' 2024-09-13T11:16:29.297 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T11:16:29.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T11:16:29.354 INFO:tasks.workunit:Stopping ['rados/test_libcephsqlite.sh cephsqlite'] on client.0... 2024-09-13T11:16:29.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T11:16:29.699 DEBUG:teuthology.parallel:result is None 2024-09-13T11:16:29.699 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T11:16:29.712 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T11:16:29.713 DEBUG:teuthology.orchestra.run.smithi039:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-13T11:16:29.771 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T11:16:29.771 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T11:16:29.784 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T11:16:29.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:16:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 Processor -- start 2024-09-13T11:16:29.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 -- start start 2024-09-13T11:16:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3cd00b6d50 0x7f3cd0073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 0x7f3cd0142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd0071650 con 0x7f3cd0143300 2024-09-13T11:16:29.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd01437b0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cd60b6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd0071130 con 0x7f3cd0070c50 2024-09-13T11:16:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 0x7f3cd0142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3ccf7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3cd00b6d50 0x7f3cd0073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 0x7f3cd0142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57198/0 (socket says 172.21.15.39:57198) 2024-09-13T11:16:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3ccf7fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3cd00b6d50 0x7f3cd0073cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35816/0 (socket says 172.21.15.39:35816) 2024-09-13T11:16:29.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 -- 172.21.15.39:0/104279032 learned_addr learned my addr 172.21.15.39:0/104279032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 -- 172.21.15.39:0/104279032 >> v2:172.21.15.39:3300/0 conn(0x7f3cd00b6d50 msgr2=0x7f3cd0073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 --2- 172.21.15.39:0/104279032 >> v2:172.21.15.39:3300/0 conn(0x7f3cd00b6d50 0x7f3cd0073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 -- 172.21.15.39:0/104279032 >> v1:172.21.15.102:6789/0 conn(0x7f3cd0143300 legacy=0x7f3cd006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:29.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.937+0000 7f3cceffd640 1 -- 172.21.15.39:0/104279032 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00b52f0 con 0x7f3cd0070c50 2024-09-13T11:16:29.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 --2- 172.21.15.39:0/104279032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 0x7f3cd0142dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd67d9f4248fcce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:29.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cce7fc640 1 -- 172.21.15.39:0/104279032 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00ab650 con 0x7f3cd0070c50 2024-09-13T11:16:29.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cce7fc640 1 -- 172.21.15.39:0/104279032 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc00b0070 con 0x7f3cd0070c50 2024-09-13T11:16:29.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cce7fc640 1 -- 172.21.15.39:0/104279032 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00aba10 con 0x7f3cd0070c50 2024-09-13T11:16:29.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/104279032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 msgr2=0x7f3cd0142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:29.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/104279032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 0x7f3cd0142dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc001c4b0 comp rx=0 tx=0).stop 2024-09-13T11:16:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/104279032 shutdown_connections 2024-09-13T11:16:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/104279032 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd0070c50 0x7f3cd0142dc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/104279032 >> v2:172.21.15.39:3300/0 conn(0x7f3cd00b6d50 0x7f3cd0073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/104279032 >> 172.21.15.39:0/104279032 conn(0x7f3cd00b9ee0 msgr2=0x7f3cd00b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:29.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/104279032 shutdown_connections 2024-09-13T11:16:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/104279032 wait complete. 2024-09-13T11:16:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 Processor -- start 2024-09-13T11:16:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- start start 2024-09-13T11:16:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cd0070c50 0x7f3cd0141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:29.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 0x7f3cd013ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cd0143300 0x7f3cd0137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd0150e10 con 0x7f3cd0143300 2024-09-13T11:16:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd0150c90 con 0x7f3cd0070c50 2024-09-13T11:16:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd0150f90 con 0x7f3cd00b6d50 2024-09-13T11:16:29.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 0x7f3cd013ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:29.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 0x7f3cd013ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57204/0 (socket says 172.21.15.39:57204) 2024-09-13T11:16:29.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 -- 172.21.15.39:0/729959482 learned_addr learned my addr 172.21.15.39:0/729959482 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:29.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3ccffff640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cd0143300 0x7f3cd0137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:29.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 -- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cd0070c50 msgr2=0x7f3cd0141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:29.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cd0070c50 0x7f3cd0141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:29.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 -- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cd0143300 msgr2=0x7f3cd0137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:29.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cd0143300 0x7f3cd0137890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:29.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 -- 172.21.15.39:0/729959482 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd01391c0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cceffd640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 0x7f3cd013ff90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0000c10 tx=0x7f3cc001acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:29.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00b4800 con 0x7f3cd00b6d50 2024-09-13T11:16:29.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc00b49c0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd01394a0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00b4db0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.941+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd0147b40 con 0x7f3cd00b6d50 2024-09-13T11:16:29.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.945+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd0142dc0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.945+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f3cc00b3380 con 0x7f3cd00b6d50 2024-09-13T11:16:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.945+0000 7f3cb7fff640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f3cbc072100 0x7f3cbc0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.945+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f3cc012d4f0 con 0x7f3cd00b6d50 2024-09-13T11:16:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.945+0000 7f3ccf7fe640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f3cbc072100 0x7f3cbc0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:29.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.945+0000 7f3ccf7fe640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f3cbc072100 0x7f3cbc0745c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006aa0 tx=0x7f3cc4006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:29.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:29.949+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f3cc0016130 con 0x7f3cd00b6d50 2024-09-13T11:16:30.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.117+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cd0074ab0 con 0x7f3cbc072100 2024-09-13T11:16:30.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cb7fff640 1 -- 172.21.15.39:0/729959482 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117465 (secure 0 0 0) 0x7f3cd0074ab0 con 0x7f3cbc072100 2024-09-13T11:16:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:16:30.133 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:16:30.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f3cbc072100 msgr2=0x7f3cbc0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f3cbc072100 0x7f3cbc0745c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4006aa0 tx=0x7f3cc4006a30 comp rx=0 tx=0).stop 2024-09-13T11:16:30.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 msgr2=0x7f3cd013ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 0x7f3cd013ff90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0000c10 tx=0x7f3cc001acf0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 shutdown_connections 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f3cbc072100 0x7f3cbc0745c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cd0143300 0x7f3cd0137890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f3cd00b6d50 0x7f3cd013ff90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 --2- 172.21.15.39:0/729959482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cd0070c50 0x7f3cd0141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 >> 172.21.15.39:0/729959482 conn(0x7f3cd00b9ee0 msgr2=0x7f3cd00b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 shutdown_connections 2024-09-13T11:16:30.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.129+0000 7f3cd60b6640 1 -- 172.21.15.39:0/729959482 wait complete. 2024-09-13T11:16:30.151 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T11:16:30.065413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3579348283,"num_objects":885,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":885,"num_whiteouts":0,"num_read":2620,"num_read_kb":2620,"num_write":162866,"num_write_kb":5650383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164591,"ondisk_log_size":164591,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8207888,"kb_used_data":6992720,"kb_used_omap":12,"kb_used_meta":1215027,"kb_avail":746766832,"statfs":{"total":773094113280,"available":764689235968,"internally_reserved":0,"allocated":7160545280,"data_stored":7159170662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1244188209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003592"},"pg_stats":[{"pgid":"3.1f","version":"23'3476","reported_seq":3493,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.393000+0000","last_change":"2024-09-13T11:12:05.719358+0000","last_active":"2024-09-13T11:15:13.393000+0000","last_peered":"2024-09-13T11:15:13.393000+0000","last_clean":"2024-09-13T11:15:13.393000+0000","last_became_active":"2024-09-13T11:12:05.719081+0000","last_became_peered":"2024-09-13T11:12:05.719081+0000","last_unstale":"2024-09-13T11:15:13.393000+0000","last_undegraded":"2024-09-13T11:15:13.393000+0000","last_fullsized":"2024-09-13T11:15:13.393000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3476,"log_dups_size":0,"ondisk_log_size":3476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:56.858667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90834768,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":159322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'5688","reported_seq":5713,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:20.470892+0000","last_change":"2024-09-13T11:12:05.710129+0000","last_active":"2024-09-13T11:15:20.470892+0000","last_peered":"2024-09-13T11:15:20.470892+0000","last_clean":"2024-09-13T11:15:20.470892+0000","last_became_active":"2024-09-13T11:12:05.709855+0000","last_became_peered":"2024-09-13T11:12:05.709855+0000","last_unstale":"2024-09-13T11:15:20.470892+0000","last_undegraded":"2024-09-13T11:15:20.470892+0000","last_fullsized":"2024-09-13T11:15:20.470892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5688,"log_dups_size":0,"ondisk_log_size":5688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:54.761992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117572096,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":28,"num_read_kb":84,"num_write":5683,"num_write_kb":165192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4915","reported_seq":4941,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197798+0000","last_change":"2024-09-13T11:12:05.730996+0000","last_active":"2024-09-13T11:16:29.197798+0000","last_peered":"2024-09-13T11:16:29.197798+0000","last_clean":"2024-09-13T11:16:29.197798+0000","last_became_active":"2024-09-13T11:12:05.730262+0000","last_became_peered":"2024-09-13T11:12:05.730262+0000","last_unstale":"2024-09-13T11:16:29.197798+0000","last_undegraded":"2024-09-13T11:16:29.197798+0000","last_fullsized":"2024-09-13T11:16:29.197798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4915,"log_dups_size":0,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:17.111335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":4903,"num_write_kb":132100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4411","reported_seq":4430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196379+0000","last_change":"2024-09-13T11:12:05.728308+0000","last_active":"2024-09-13T11:16:29.196379+0000","last_peered":"2024-09-13T11:16:29.196379+0000","last_clean":"2024-09-13T11:16:29.196379+0000","last_became_active":"2024-09-13T11:12:05.727615+0000","last_became_peered":"2024-09-13T11:12:05.727615+0000","last_unstale":"2024-09-13T11:16:29.196379+0000","last_undegraded":"2024-09-13T11:16:29.196379+0000","last_fullsized":"2024-09-13T11:16:29.196379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:49.921089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117506568,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4416,"num_write_kb":182807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'2876","reported_seq":2892,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.767458+0000","last_change":"2024-09-13T11:12:05.726002+0000","last_active":"2024-09-13T11:15:13.767458+0000","last_peered":"2024-09-13T11:15:13.767458+0000","last_clean":"2024-09-13T11:15:13.767458+0000","last_became_active":"2024-09-13T11:12:05.725707+0000","last_became_peered":"2024-09-13T11:12:05.725707+0000","last_unstale":"2024-09-13T11:15:13.767458+0000","last_undegraded":"2024-09-13T11:15:13.767458+0000","last_fullsized":"2024-09-13T11:15:13.767458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2876,"log_dups_size":0,"ondisk_log_size":2876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:18:45.458853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2825,"num_write_kb":115717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'4755","reported_seq":4877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151751+0000","last_change":"2024-09-13T11:12:05.707268+0000","last_active":"2024-09-13T11:16:29.151751+0000","last_peered":"2024-09-13T11:16:29.151751+0000","last_clean":"2024-09-13T11:16:29.151751+0000","last_became_active":"2024-09-13T11:12:05.706491+0000","last_became_peered":"2024-09-13T11:12:05.706491+0000","last_unstale":"2024-09-13T11:16:29.151751+0000","last_undegraded":"2024-09-13T11:16:29.151751+0000","last_fullsized":"2024-09-13T11:16:29.151751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:36.756608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58983456,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":4748,"num_write_kb":132323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"24'5659","reported_seq":5679,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:29.327921+0000","last_change":"2024-09-13T11:12:05.705309+0000","last_active":"2024-09-13T11:15:29.327921+0000","last_peered":"2024-09-13T11:15:29.327921+0000","last_clean":"2024-09-13T11:15:29.327921+0000","last_became_active":"2024-09-13T11:12:05.704854+0000","last_became_peered":"2024-09-13T11:12:05.704854+0000","last_unstale":"2024-09-13T11:15:29.327921+0000","last_undegraded":"2024-09-13T11:15:29.327921+0000","last_fullsized":"2024-09-13T11:15:29.327921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5659,"log_dups_size":0,"ondisk_log_size":5659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:16.712542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":5619,"num_write_kb":211837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'9115","reported_seq":9131,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:29.885612+0000","last_change":"2024-09-13T11:12:05.708931+0000","last_active":"2024-09-13T11:15:29.885612+0000","last_peered":"2024-09-13T11:15:29.885612+0000","last_clean":"2024-09-13T11:15:29.885612+0000","last_became_active":"2024-09-13T11:12:05.708741+0000","last_became_peered":"2024-09-13T11:12:05.708741+0000","last_unstale":"2024-09-13T11:15:29.885612+0000","last_undegraded":"2024-09-13T11:15:29.885612+0000","last_fullsized":"2024-09-13T11:15:29.885612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9115,"log_dups_size":0,"ondisk_log_size":9115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:21:41.221566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9109,"num_write_kb":263300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'6180","reported_seq":6202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:32.438148+0000","last_change":"2024-09-13T11:12:05.718373+0000","last_active":"2024-09-13T11:15:32.438148+0000","last_peered":"2024-09-13T11:15:32.438148+0000","last_clean":"2024-09-13T11:15:32.438148+0000","last_became_active":"2024-09-13T11:12:05.718074+0000","last_became_peered":"2024-09-13T11:12:05.718074+0000","last_unstale":"2024-09-13T11:15:32.438148+0000","last_undegraded":"2024-09-13T11:15:32.438148+0000","last_fullsized":"2024-09-13T11:15:32.438148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:42.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":6189,"num_write_kb":150954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'3312","reported_seq":3330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197817+0000","last_change":"2024-09-13T11:12:05.719775+0000","last_active":"2024-09-13T11:16:29.197817+0000","last_peered":"2024-09-13T11:16:29.197817+0000","last_clean":"2024-09-13T11:16:29.197817+0000","last_became_active":"2024-09-13T11:12:05.716472+0000","last_became_peered":"2024-09-13T11:12:05.716472+0000","last_unstale":"2024-09-13T11:16:29.197817+0000","last_undegraded":"2024-09-13T11:16:29.197817+0000","last_fullsized":"2024-09-13T11:16:29.197817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:12.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85395112,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3286,"num_write_kb":133748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'6541","reported_seq":6562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171301+0000","last_change":"2024-09-13T11:12:05.723073+0000","last_active":"2024-09-13T11:16:29.171301+0000","last_peered":"2024-09-13T11:16:29.171301+0000","last_clean":"2024-09-13T11:16:29.171301+0000","last_became_active":"2024-09-13T11:12:05.722294+0000","last_became_peered":"2024-09-13T11:12:05.722294+0000","last_unstale":"2024-09-13T11:16:29.171301+0000","last_undegraded":"2024-09-13T11:16:29.171301+0000","last_fullsized":"2024-09-13T11:16:29.171301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6541,"log_dups_size":0,"ondisk_log_size":6541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:16.657467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6545,"num_write_kb":158257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'6358","reported_seq":6375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.152232+0000","last_change":"2024-09-13T11:12:05.714322+0000","last_active":"2024-09-13T11:16:29.152232+0000","last_peered":"2024-09-13T11:16:29.152232+0000","last_clean":"2024-09-13T11:16:29.152232+0000","last_became_active":"2024-09-13T11:12:05.713307+0000","last_became_peered":"2024-09-13T11:12:05.713307+0000","last_unstale":"2024-09-13T11:16:29.152232+0000","last_undegraded":"2024-09-13T11:16:29.152232+0000","last_fullsized":"2024-09-13T11:16:29.152232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6358,"log_dups_size":0,"ondisk_log_size":6358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:57.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":215299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.307796+0000","last_change":"2024-09-13T11:11:59.264383+0000","last_active":"2024-09-13T11:15:13.307796+0000","last_peered":"2024-09-13T11:15:13.307796+0000","last_clean":"2024-09-13T11:15:13.307796+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:15:13.307796+0000","last_undegraded":"2024-09-13T11:15:13.307796+0000","last_fullsized":"2024-09-13T11:15:13.307796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:19.549032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'6805","reported_seq":6848,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:34.198516+0000","last_change":"2024-09-13T11:12:05.707737+0000","last_active":"2024-09-13T11:15:34.198516+0000","last_peered":"2024-09-13T11:15:34.198516+0000","last_clean":"2024-09-13T11:15:34.198516+0000","last_became_active":"2024-09-13T11:12:05.707378+0000","last_became_peered":"2024-09-13T11:12:05.707378+0000","last_unstale":"2024-09-13T11:15:34.198516+0000","last_undegraded":"2024-09-13T11:15:34.198516+0000","last_fullsized":"2024-09-13T11:15:34.198516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6805,"log_dups_size":0,"ondisk_log_size":6805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:27.559821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":6821,"num_write_kb":193336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.323787+0000","last_change":"2024-09-13T11:11:59.170926+0000","last_active":"2024-09-13T11:15:13.323787+0000","last_peered":"2024-09-13T11:15:13.323787+0000","last_clean":"2024-09-13T11:15:13.323787+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:15:13.323787+0000","last_undegraded":"2024-09-13T11:15:13.323787+0000","last_fullsized":"2024-09-13T11:15:13.323787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:28.792477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'4653","reported_seq":4680,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.777443+0000","last_change":"2024-09-13T11:12:05.711115+0000","last_active":"2024-09-13T11:15:13.777443+0000","last_peered":"2024-09-13T11:15:13.777443+0000","last_clean":"2024-09-13T11:15:13.777443+0000","last_became_active":"2024-09-13T11:12:05.710876+0000","last_became_peered":"2024-09-13T11:12:05.710876+0000","last_unstale":"2024-09-13T11:15:13.777443+0000","last_undegraded":"2024-09-13T11:15:13.777443+0000","last_fullsized":"2024-09-13T11:15:13.777443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:43.433333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107063120,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":4630,"num_write_kb":171206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.172123+0000","last_change":"2024-09-13T11:11:59.264364+0000","last_active":"2024-09-13T11:16:29.172123+0000","last_peered":"2024-09-13T11:16:29.172123+0000","last_clean":"2024-09-13T11:16:29.172123+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:16:29.172123+0000","last_undegraded":"2024-09-13T11:16:29.172123+0000","last_fullsized":"2024-09-13T11:16:29.172123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:46.598343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8136","reported_seq":8158,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:31.838203+0000","last_change":"2024-09-13T11:12:05.889138+0000","last_active":"2024-09-13T11:15:31.838203+0000","last_peered":"2024-09-13T11:15:31.838203+0000","last_clean":"2024-09-13T11:15:31.838203+0000","last_became_active":"2024-09-13T11:12:05.888409+0000","last_became_peered":"2024-09-13T11:12:05.888409+0000","last_unstale":"2024-09-13T11:15:31.838203+0000","last_undegraded":"2024-09-13T11:15:31.838203+0000","last_fullsized":"2024-09-13T11:15:31.838203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8136,"log_dups_size":0,"ondisk_log_size":8136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:16.890148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543104,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":8142,"num_write_kb":253572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.323610+0000","last_change":"2024-09-13T11:11:59.171084+0000","last_active":"2024-09-13T11:15:13.323610+0000","last_peered":"2024-09-13T11:15:13.323610+0000","last_clean":"2024-09-13T11:15:13.323610+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:15:13.323610+0000","last_undegraded":"2024-09-13T11:15:13.323610+0000","last_fullsized":"2024-09-13T11:15:13.323610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:01.700221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'4755","reported_seq":4774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197667+0000","last_change":"2024-09-13T11:12:05.729028+0000","last_active":"2024-09-13T11:16:29.197667+0000","last_peered":"2024-09-13T11:16:29.197667+0000","last_clean":"2024-09-13T11:16:29.197667+0000","last_became_active":"2024-09-13T11:12:05.726919+0000","last_became_peered":"2024-09-13T11:12:05.726919+0000","last_unstale":"2024-09-13T11:16:29.197667+0000","last_undegraded":"2024-09-13T11:16:29.197667+0000","last_fullsized":"2024-09-13T11:16:29.197667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:42.310569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4753,"num_write_kb":177157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'6488","reported_seq":6831,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151891+0000","last_change":"2024-09-13T11:12:05.724178+0000","last_active":"2024-09-13T11:16:29.151891+0000","last_peered":"2024-09-13T11:16:29.151891+0000","last_clean":"2024-09-13T11:16:29.151891+0000","last_became_active":"2024-09-13T11:12:05.715353+0000","last_became_peered":"2024-09-13T11:12:05.715353+0000","last_unstale":"2024-09-13T11:16:29.151891+0000","last_undegraded":"2024-09-13T11:16:29.151891+0000","last_fullsized":"2024-09-13T11:16:29.151891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6488,"log_dups_size":0,"ondisk_log_size":6488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:39:43.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1078,"num_read_kb":960,"num_write":6740,"num_write_kb":218838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196274+0000","last_change":"2024-09-13T11:11:59.177551+0000","last_active":"2024-09-13T11:16:29.196274+0000","last_peered":"2024-09-13T11:16:29.196274+0000","last_clean":"2024-09-13T11:16:29.196274+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:16:29.196274+0000","last_undegraded":"2024-09-13T11:16:29.196274+0000","last_fullsized":"2024-09-13T11:16:29.196274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:06.698959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"24'3583","reported_seq":3600,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.768120+0000","last_change":"2024-09-13T11:12:05.890104+0000","last_active":"2024-09-13T11:15:13.768120+0000","last_peered":"2024-09-13T11:15:13.768120+0000","last_clean":"2024-09-13T11:15:13.768120+0000","last_became_active":"2024-09-13T11:12:05.889331+0000","last_became_peered":"2024-09-13T11:12:05.889331+0000","last_unstale":"2024-09-13T11:15:13.768120+0000","last_undegraded":"2024-09-13T11:15:13.768120+0000","last_fullsized":"2024-09-13T11:15:13.768120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3583,"log_dups_size":0,"ondisk_log_size":3583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:36.750096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3535,"num_write_kb":168833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.318703+0000","last_change":"2024-09-13T11:11:59.262864+0000","last_active":"2024-09-13T11:15:13.318703+0000","last_peered":"2024-09-13T11:15:13.318703+0000","last_clean":"2024-09-13T11:15:13.318703+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:15:13.318703+0000","last_undegraded":"2024-09-13T11:15:13.318703+0000","last_fullsized":"2024-09-13T11:15:13.318703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:49.061602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'3817","reported_seq":3834,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.771059+0000","last_change":"2024-09-13T11:12:05.716843+0000","last_active":"2024-09-13T11:15:13.771059+0000","last_peered":"2024-09-13T11:15:13.771059+0000","last_clean":"2024-09-13T11:15:13.771059+0000","last_became_active":"2024-09-13T11:12:05.716555+0000","last_became_peered":"2024-09-13T11:12:05.716555+0000","last_unstale":"2024-09-13T11:15:13.771059+0000","last_undegraded":"2024-09-13T11:15:13.771059+0000","last_fullsized":"2024-09-13T11:15:13.771059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3817,"log_dups_size":0,"ondisk_log_size":3817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:33.343050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":161030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171199+0000","last_change":"2024-09-13T11:11:59.264363+0000","last_active":"2024-09-13T11:16:29.171199+0000","last_peered":"2024-09-13T11:16:29.171199+0000","last_clean":"2024-09-13T11:16:29.171199+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:16:29.171199+0000","last_undegraded":"2024-09-13T11:16:29.171199+0000","last_fullsized":"2024-09-13T11:16:29.171199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:02.989025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'5147","reported_seq":5183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:26.496646+0000","last_change":"2024-09-13T11:12:05.717945+0000","last_active":"2024-09-13T11:15:26.496646+0000","last_peered":"2024-09-13T11:15:26.496646+0000","last_clean":"2024-09-13T11:15:26.496646+0000","last_became_active":"2024-09-13T11:12:05.717715+0000","last_became_peered":"2024-09-13T11:12:05.717715+0000","last_unstale":"2024-09-13T11:15:26.496646+0000","last_undegraded":"2024-09-13T11:15:26.496646+0000","last_fullsized":"2024-09-13T11:15:26.496646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5147,"log_dups_size":0,"ondisk_log_size":5147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:00:42.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":5176,"num_write_kb":147263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196089+0000","last_change":"2024-09-13T11:11:59.175526+0000","last_active":"2024-09-13T11:16:29.196089+0000","last_peered":"2024-09-13T11:16:29.196089+0000","last_clean":"2024-09-13T11:16:29.196089+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:16:29.196089+0000","last_undegraded":"2024-09-13T11:16:29.196089+0000","last_fullsized":"2024-09-13T11:16:29.196089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:13.643417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171211+0000","last_change":"2024-09-13T11:11:49.099967+0000","last_active":"2024-09-13T11:16:29.171211+0000","last_peered":"2024-09-13T11:16:29.171211+0000","last_clean":"2024-09-13T11:16:29.171211+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:16:29.171211+0000","last_undegraded":"2024-09-13T11:16:29.171211+0000","last_fullsized":"2024-09-13T11:16:29.171211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_clean_scrub_stamp":"2024-09-13T11:11:48.073845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:02.753349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"24'2972","reported_seq":2998,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.772941+0000","last_change":"2024-09-13T11:12:05.700433+0000","last_active":"2024-09-13T11:15:13.772941+0000","last_peered":"2024-09-13T11:15:13.772941+0000","last_clean":"2024-09-13T11:15:13.772941+0000","last_became_active":"2024-09-13T11:12:05.700153+0000","last_became_peered":"2024-09-13T11:12:05.700153+0000","last_unstale":"2024-09-13T11:15:13.772941+0000","last_undegraded":"2024-09-13T11:15:13.772941+0000","last_fullsized":"2024-09-13T11:15:13.772941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2972,"log_dups_size":0,"ondisk_log_size":2972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:13.356022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104988672,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":2914,"num_write_kb":144131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'8252","reported_seq":8395,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.241374+0000","last_change":"2024-09-13T11:12:05.888680+0000","last_active":"2024-09-13T11:16:29.241374+0000","last_peered":"2024-09-13T11:16:29.241374+0000","last_clean":"2024-09-13T11:16:29.241374+0000","last_became_active":"2024-09-13T11:12:05.888170+0000","last_became_peered":"2024-09-13T11:12:05.888170+0000","last_unstale":"2024-09-13T11:16:29.241374+0000","last_undegraded":"2024-09-13T11:16:29.241374+0000","last_fullsized":"2024-09-13T11:16:29.241374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8252,"log_dups_size":0,"ondisk_log_size":8252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:46:22.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114688000,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":430,"num_read_kb":380,"num_write":6298,"num_write_kb":189330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"24'5168","reported_seq":5188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:31.760296+0000","last_change":"2024-09-13T11:12:05.727588+0000","last_active":"2024-09-13T11:15:31.760296+0000","last_peered":"2024-09-13T11:15:31.760296+0000","last_clean":"2024-09-13T11:15:31.760296+0000","last_became_active":"2024-09-13T11:12:05.726759+0000","last_became_peered":"2024-09-13T11:12:05.726759+0000","last_unstale":"2024-09-13T11:15:31.760296+0000","last_undegraded":"2024-09-13T11:15:31.760296+0000","last_fullsized":"2024-09-13T11:15:31.760296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5168,"log_dups_size":0,"ondisk_log_size":5168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:38.027194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":5148,"num_write_kb":185606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'4264","reported_seq":4292,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.387902+0000","last_change":"2024-09-13T11:12:05.709828+0000","last_active":"2024-09-13T11:15:13.387902+0000","last_peered":"2024-09-13T11:15:13.387902+0000","last_clean":"2024-09-13T11:15:13.387902+0000","last_became_active":"2024-09-13T11:12:05.709368+0000","last_became_peered":"2024-09-13T11:12:05.709368+0000","last_unstale":"2024-09-13T11:15:13.387902+0000","last_undegraded":"2024-09-13T11:15:13.387902+0000","last_fullsized":"2024-09-13T11:15:13.387902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":0,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.129402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121635328,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":4285,"num_write_kb":189832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'4764","reported_seq":4788,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196993+0000","last_change":"2024-09-13T11:12:05.719371+0000","last_active":"2024-09-13T11:16:29.196993+0000","last_peered":"2024-09-13T11:16:29.196993+0000","last_clean":"2024-09-13T11:16:29.196993+0000","last_became_active":"2024-09-13T11:12:05.716884+0000","last_became_peered":"2024-09-13T11:12:05.716884+0000","last_unstale":"2024-09-13T11:16:29.196993+0000","last_undegraded":"2024-09-13T11:16:29.196993+0000","last_fullsized":"2024-09-13T11:16:29.196993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:34.250313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130220552,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":27,"num_read_kb":83,"num_write":4732,"num_write_kb":234695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3101","reported_seq":3135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171732+0000","last_change":"2024-09-13T11:12:05.731406+0000","last_active":"2024-09-13T11:16:29.171732+0000","last_peered":"2024-09-13T11:16:29.171732+0000","last_clean":"2024-09-13T11:16:29.171732+0000","last_became_active":"2024-09-13T11:12:05.730642+0000","last_became_peered":"2024-09-13T11:12:05.730642+0000","last_unstale":"2024-09-13T11:16:29.171732+0000","last_undegraded":"2024-09-13T11:16:29.171732+0000","last_fullsized":"2024-09-13T11:16:29.171732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3101,"log_dups_size":0,"ondisk_log_size":3101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:34.115785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98697744,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":61,"num_read_kb":48,"num_write":3111,"num_write_kb":136971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'4813","reported_seq":4935,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.214604+0000","last_change":"2024-09-13T11:12:05.731761+0000","last_active":"2024-09-13T11:16:29.214604+0000","last_peered":"2024-09-13T11:16:29.214604+0000","last_clean":"2024-09-13T11:16:29.214604+0000","last_became_active":"2024-09-13T11:12:05.731054+0000","last_became_peered":"2024-09-13T11:12:05.731054+0000","last_unstale":"2024-09-13T11:16:29.214604+0000","last_undegraded":"2024-09-13T11:16:29.214604+0000","last_fullsized":"2024-09-13T11:16:29.214604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4813,"log_dups_size":0,"ondisk_log_size":4813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:45.840805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120398352,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":345,"num_read_kb":457,"num_write":5199,"num_write_kb":163956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'5304","reported_seq":5322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.246195+0000","last_change":"2024-09-13T11:12:05.723811+0000","last_active":"2024-09-13T11:16:29.246195+0000","last_peered":"2024-09-13T11:16:29.246195+0000","last_clean":"2024-09-13T11:16:29.246195+0000","last_became_active":"2024-09-13T11:12:05.722874+0000","last_became_peered":"2024-09-13T11:12:05.722874+0000","last_unstale":"2024-09-13T11:16:29.246195+0000","last_undegraded":"2024-09-13T11:16:29.246195+0000","last_fullsized":"2024-09-13T11:16:29.246195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5304,"log_dups_size":0,"ondisk_log_size":5304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.959449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148860928,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":228833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"24'2493","reported_seq":2511,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.763829+0000","last_change":"2024-09-13T11:12:05.713322+0000","last_active":"2024-09-13T11:15:13.763829+0000","last_peered":"2024-09-13T11:15:13.763829+0000","last_clean":"2024-09-13T11:15:13.763829+0000","last_became_active":"2024-09-13T11:12:05.712482+0000","last_became_peered":"2024-09-13T11:12:05.712482+0000","last_unstale":"2024-09-13T11:15:13.763829+0000","last_undegraded":"2024-09-13T11:15:13.763829+0000","last_fullsized":"2024-09-13T11:15:13.763829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2493,"log_dups_size":0,"ondisk_log_size":2493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:50.799467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497984,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2455,"num_write_kb":115332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4070","reported_seq":4090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171469+0000","last_change":"2024-09-13T11:12:05.729681+0000","last_active":"2024-09-13T11:16:29.171469+0000","last_peered":"2024-09-13T11:16:29.171469+0000","last_clean":"2024-09-13T11:16:29.171469+0000","last_became_active":"2024-09-13T11:12:05.728964+0000","last_became_peered":"2024-09-13T11:12:05.728964+0000","last_unstale":"2024-09-13T11:16:29.171469+0000","last_undegraded":"2024-09-13T11:16:29.171469+0000","last_fullsized":"2024-09-13T11:16:29.171469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:54.843915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99232096,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":4074,"num_write_kb":180077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'3595","reported_seq":3616,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.764513+0000","last_change":"2024-09-13T11:12:05.720869+0000","last_active":"2024-09-13T11:15:13.764513+0000","last_peered":"2024-09-13T11:15:13.764513+0000","last_clean":"2024-09-13T11:15:13.764513+0000","last_became_active":"2024-09-13T11:12:05.720600+0000","last_became_peered":"2024-09-13T11:12:05.720600+0000","last_unstale":"2024-09-13T11:15:13.764513+0000","last_undegraded":"2024-09-13T11:15:13.764513+0000","last_fullsized":"2024-09-13T11:15:13.764513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:58:51.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":152845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'9050","reported_seq":9082,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171396+0000","last_change":"2024-09-13T11:12:05.731290+0000","last_active":"2024-09-13T11:16:29.171396+0000","last_peered":"2024-09-13T11:16:29.171396+0000","last_clean":"2024-09-13T11:16:29.171396+0000","last_became_active":"2024-09-13T11:12:05.729859+0000","last_became_peered":"2024-09-13T11:12:05.729859+0000","last_unstale":"2024-09-13T11:16:29.171396+0000","last_undegraded":"2024-09-13T11:16:29.171396+0000","last_fullsized":"2024-09-13T11:16:29.171396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9050,"log_dups_size":0,"ondisk_log_size":9050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:53:12.549090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":9057,"num_write_kb":215054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3578757896,"num_objects":881,"num_object_clones":0,"num_object_copies":1762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":2554,"num_read_kb":2565,"num_write":162763,"num_write_kb":5648753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7157350400,"data_stored":7157253648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164516,"ondisk_log_size":164516,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286328,"kb_used_data":1102504,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93085512,"statfs":{"total":96636764160,"available":95319564288,"internally_reserved":0,"allocated":1128964096,"data_stored":1128781606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":188217803},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077852,"kb_used_data":916236,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":93293988,"statfs":{"total":96636764160,"available":95533043712,"internally_reserved":0,"allocated":938225664,"data_stored":938048425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1685516,"kb_used_data":1437884,"kb_used_omap":1,"kb_used_meta":247614,"kb_avail":92686324,"statfs":{"total":96636764160,"available":94910795776,"internally_reserved":0,"allocated":1472393216,"data_stored":1472211750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253557189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429572,"kb_used_data":349876,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":93942268,"statfs":{"total":96636764160,"available":96196882432,"internally_reserved":0,"allocated":358273024,"data_stored":358115198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765328,"kb_used_data":635648,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":93606512,"statfs":{"total":96636764160,"available":95853068288,"internally_reserved":0,"allocated":650903552,"data_stored":650734513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361036,"kb_used_data":303484,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94010804,"statfs":{"total":96636764160,"available":96267063296,"internally_reserved":0,"allocated":310767616,"data_stored":310602622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1312892,"kb_used_data":1137388,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":93058948,"statfs":{"total":96636764160,"available":95292362752,"internally_reserved":0,"allocated":1164685312,"data_stored":1164514518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179698119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1289364,"kb_used_data":1109700,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":93082476,"statfs":{"total":96636764160,"available":95316455424,"internally_reserved":0,"allocated":1136332800,"data_stored":1136162030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1135489024,"data_stored":1135479632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":650649600,"data_stored":650642464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":358023168,"data_stored":358023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1164435456,"data_stored":1164422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1472143360,"data_stored":1472119720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":937971712,"data_stored":937956376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":310517760,"data_stored":310510592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1128120320,"data_stored":1128099208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:16:30.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:16:30.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.273+0000 7fe1d4186640 1 Processor -- start 2024-09-13T11:16:30.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.273+0000 7fe1d4186640 1 -- start start 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d4186640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 0x7fe1cc145170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d4186640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 0x7fe1cc138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d4186640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1cc1418c0 0x7fe1cc141d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d4186640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe1cc0b2db0 con 0x7fe1cc0b29d0 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d4186640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe1cc0ac320 con 0x7fe1cc1418c0 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d4186640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0ac600 con 0x7fe1cc137d10 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1f22640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 0x7fe1cc145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 0x7fe1cc138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1f22640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 0x7fe1cc145170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35828/0 (socket says 172.21.15.39:35828) 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 0x7fe1cc138150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57216/0 (socket says 172.21.15.39:57216) 2024-09-13T11:16:30.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1f22640 1 -- 172.21.15.39:0/3949436416 learned_addr learned my addr 172.21.15.39:0/3949436416 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d2723640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.102:3300/0 conn(0x7fe1cc1418c0 0x7fe1cc141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 -- 172.21.15.39:0/3949436416 >> v2:172.21.15.102:3300/0 conn(0x7fe1cc1418c0 msgr2=0x7fe1cc141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.102:3300/0 conn(0x7fe1cc1418c0 0x7fe1cc141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 -- 172.21.15.39:0/3949436416 >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 msgr2=0x7fe1cc145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 0x7fe1cc145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 -- 172.21.15.39:0/3949436416 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc145a00 con 0x7fe1cc137d10 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d2723640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.102:3300/0 conn(0x7fe1cc1418c0 0x7fe1cc141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:16:30.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1f22640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 0x7fe1cc145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:30.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d1721640 1 --2- 172.21.15.39:0/3949436416 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 0x7fe1cc138150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc074030 tx=0x7fe1bc01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f0e648717a6723 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d0f20640 1 -- 172.21.15.39:0/3949436416 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0b0070 con 0x7fe1cc137d10 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d0f20640 1 -- 172.21.15.39:0/3949436416 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0ab600 con 0x7fe1cc137d10 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.277+0000 7fe1d0f20640 1 -- 172.21.15.39:0/3949436416 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0ab9d0 con 0x7fe1cc137d10 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/3949436416 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 msgr2=0x7fe1cc138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- 172.21.15.39:0/3949436416 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 0x7fe1cc138150 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc074030 tx=0x7fe1bc01c3d0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/3949436416 shutdown_connections 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.102:3300/0 conn(0x7fe1cc1418c0 0x7fe1cc141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- 172.21.15.39:0/3949436416 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc137d10 0x7fe1cc138150 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- 172.21.15.39:0/3949436416 >> v2:172.21.15.39:3300/0 conn(0x7fe1cc0b29d0 0x7fe1cc145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/3949436416 >> 172.21.15.39:0/3949436416 conn(0x7fe1cc0b5dd0 msgr2=0x7fe1cc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/3949436416 shutdown_connections 2024-09-13T11:16:30.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/3949436416 wait complete. 2024-09-13T11:16:30.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 Processor -- start 2024-09-13T11:16:30.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- start start 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc0b29d0 0x7fe1cc1dd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1cc137d10 0x7fe1cc130270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1418c0 0x7fe1cc1307b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc071330 con 0x7fe1cc1418c0 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0711b0 con 0x7fe1cc137d10 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0714b0 con 0x7fe1cc0b29d0 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d1f22640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc0b29d0 0x7fe1cc1dd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1418c0 0x7fe1cc1307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d1f22640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc0b29d0 0x7fe1cc1dd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57218/0 (socket says 172.21.15.39:57218) 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d1f22640 1 -- 172.21.15.39:0/1241365798 learned_addr learned my addr 172.21.15.39:0/1241365798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d1721640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1cc137d10 0x7fe1cc130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 -- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc0b29d0 msgr2=0x7fe1cc1dd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc0b29d0 0x7fe1cc1dd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 -- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1cc137d10 msgr2=0x7fe1cc130270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1cc137d10 0x7fe1cc130270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 -- 172.21.15.39:0/1241365798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc132ec0 con 0x7fe1cc1418c0 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d1721640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1cc137d10 0x7fe1cc130270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d2723640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1418c0 0x7fe1cc1307b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c5f0 tx=0x7fe1c400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4015070 con 0x7fe1cc1418c0 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1c4011820 con 0x7fe1cc1418c0 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4011c10 con 0x7fe1cc1418c0 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc1ddb50 con 0x7fe1cc1418c0 2024-09-13T11:16:30.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc130cf0 con 0x7fe1cc1418c0 2024-09-13T11:16:30.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.281+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc1371c0 con 0x7fe1cc1418c0 2024-09-13T11:16:30.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.285+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fe1c4018070 con 0x7fe1cc1418c0 2024-09-13T11:16:30.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.285+0000 7fe1c27fc640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe1b0072100 0x7fe1b00745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.285+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7fe1c4092800 con 0x7fe1cc1418c0 2024-09-13T11:16:30.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.285+0000 7fe1d1f22640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe1b0072100 0x7fe1b00745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.285+0000 7fe1d1f22640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe1b0072100 0x7fe1b00745c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009c90 tx=0x7fe1c800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.289+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe1c405db50 con 0x7fe1cc1418c0 2024-09-13T11:16:30.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.453+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1cc1374a0 con 0x7fe1b0072100 2024-09-13T11:16:30.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.457+0000 7fe1c27fc640 1 -- 172.21.15.39:0/1241365798 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117465 (secure 0 0 0) 0x7fe1cc1374a0 con 0x7fe1b0072100 2024-09-13T11:16:30.464 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:16:30.464 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe1b0072100 msgr2=0x7fe1b00745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe1b0072100 0x7fe1b00745c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009c90 tx=0x7fe1c800d040 comp rx=0 tx=0).stop 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1418c0 msgr2=0x7fe1cc1307b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1418c0 0x7fe1cc1307b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c5f0 tx=0x7fe1c400cab0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 shutdown_connections 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe1b0072100 0x7fe1b00745c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1cc1418c0 0x7fe1cc1307b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1cc137d10 0x7fe1cc130270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 --2- 172.21.15.39:0/1241365798 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe1cc0b29d0 0x7fe1cc1dd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 >> 172.21.15.39:0/1241365798 conn(0x7fe1cc0b5dd0 msgr2=0x7fe1cc135de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 shutdown_connections 2024-09-13T11:16:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.461+0000 7fe1d4186640 1 -- 172.21.15.39:0/1241365798 wait complete. 2024-09-13T11:16:30.482 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T11:16:30.065413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3579348283,"num_objects":885,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":885,"num_whiteouts":0,"num_read":2620,"num_read_kb":2620,"num_write":162866,"num_write_kb":5650383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164591,"ondisk_log_size":164591,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8207888,"kb_used_data":6992720,"kb_used_omap":12,"kb_used_meta":1215027,"kb_avail":746766832,"statfs":{"total":773094113280,"available":764689235968,"internally_reserved":0,"allocated":7160545280,"data_stored":7159170662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1244188209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003592"},"pg_stats":[{"pgid":"3.1f","version":"23'3476","reported_seq":3493,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.393000+0000","last_change":"2024-09-13T11:12:05.719358+0000","last_active":"2024-09-13T11:15:13.393000+0000","last_peered":"2024-09-13T11:15:13.393000+0000","last_clean":"2024-09-13T11:15:13.393000+0000","last_became_active":"2024-09-13T11:12:05.719081+0000","last_became_peered":"2024-09-13T11:12:05.719081+0000","last_unstale":"2024-09-13T11:15:13.393000+0000","last_undegraded":"2024-09-13T11:15:13.393000+0000","last_fullsized":"2024-09-13T11:15:13.393000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3476,"log_dups_size":0,"ondisk_log_size":3476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:56.858667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90834768,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":159322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'5688","reported_seq":5713,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:20.470892+0000","last_change":"2024-09-13T11:12:05.710129+0000","last_active":"2024-09-13T11:15:20.470892+0000","last_peered":"2024-09-13T11:15:20.470892+0000","last_clean":"2024-09-13T11:15:20.470892+0000","last_became_active":"2024-09-13T11:12:05.709855+0000","last_became_peered":"2024-09-13T11:12:05.709855+0000","last_unstale":"2024-09-13T11:15:20.470892+0000","last_undegraded":"2024-09-13T11:15:20.470892+0000","last_fullsized":"2024-09-13T11:15:20.470892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5688,"log_dups_size":0,"ondisk_log_size":5688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:54.761992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117572096,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":28,"num_read_kb":84,"num_write":5683,"num_write_kb":165192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4915","reported_seq":4941,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197798+0000","last_change":"2024-09-13T11:12:05.730996+0000","last_active":"2024-09-13T11:16:29.197798+0000","last_peered":"2024-09-13T11:16:29.197798+0000","last_clean":"2024-09-13T11:16:29.197798+0000","last_became_active":"2024-09-13T11:12:05.730262+0000","last_became_peered":"2024-09-13T11:12:05.730262+0000","last_unstale":"2024-09-13T11:16:29.197798+0000","last_undegraded":"2024-09-13T11:16:29.197798+0000","last_fullsized":"2024-09-13T11:16:29.197798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4915,"log_dups_size":0,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:17.111335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":4903,"num_write_kb":132100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4411","reported_seq":4430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196379+0000","last_change":"2024-09-13T11:12:05.728308+0000","last_active":"2024-09-13T11:16:29.196379+0000","last_peered":"2024-09-13T11:16:29.196379+0000","last_clean":"2024-09-13T11:16:29.196379+0000","last_became_active":"2024-09-13T11:12:05.727615+0000","last_became_peered":"2024-09-13T11:12:05.727615+0000","last_unstale":"2024-09-13T11:16:29.196379+0000","last_undegraded":"2024-09-13T11:16:29.196379+0000","last_fullsized":"2024-09-13T11:16:29.196379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:49.921089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117506568,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4416,"num_write_kb":182807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'2876","reported_seq":2892,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.767458+0000","last_change":"2024-09-13T11:12:05.726002+0000","last_active":"2024-09-13T11:15:13.767458+0000","last_peered":"2024-09-13T11:15:13.767458+0000","last_clean":"2024-09-13T11:15:13.767458+0000","last_became_active":"2024-09-13T11:12:05.725707+0000","last_became_peered":"2024-09-13T11:12:05.725707+0000","last_unstale":"2024-09-13T11:15:13.767458+0000","last_undegraded":"2024-09-13T11:15:13.767458+0000","last_fullsized":"2024-09-13T11:15:13.767458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2876,"log_dups_size":0,"ondisk_log_size":2876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:18:45.458853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2825,"num_write_kb":115717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'4755","reported_seq":4877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151751+0000","last_change":"2024-09-13T11:12:05.707268+0000","last_active":"2024-09-13T11:16:29.151751+0000","last_peered":"2024-09-13T11:16:29.151751+0000","last_clean":"2024-09-13T11:16:29.151751+0000","last_became_active":"2024-09-13T11:12:05.706491+0000","last_became_peered":"2024-09-13T11:12:05.706491+0000","last_unstale":"2024-09-13T11:16:29.151751+0000","last_undegraded":"2024-09-13T11:16:29.151751+0000","last_fullsized":"2024-09-13T11:16:29.151751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:36.756608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58983456,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":4748,"num_write_kb":132323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"24'5659","reported_seq":5679,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:29.327921+0000","last_change":"2024-09-13T11:12:05.705309+0000","last_active":"2024-09-13T11:15:29.327921+0000","last_peered":"2024-09-13T11:15:29.327921+0000","last_clean":"2024-09-13T11:15:29.327921+0000","last_became_active":"2024-09-13T11:12:05.704854+0000","last_became_peered":"2024-09-13T11:12:05.704854+0000","last_unstale":"2024-09-13T11:15:29.327921+0000","last_undegraded":"2024-09-13T11:15:29.327921+0000","last_fullsized":"2024-09-13T11:15:29.327921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5659,"log_dups_size":0,"ondisk_log_size":5659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:16.712542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":5619,"num_write_kb":211837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'9115","reported_seq":9131,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:29.885612+0000","last_change":"2024-09-13T11:12:05.708931+0000","last_active":"2024-09-13T11:15:29.885612+0000","last_peered":"2024-09-13T11:15:29.885612+0000","last_clean":"2024-09-13T11:15:29.885612+0000","last_became_active":"2024-09-13T11:12:05.708741+0000","last_became_peered":"2024-09-13T11:12:05.708741+0000","last_unstale":"2024-09-13T11:15:29.885612+0000","last_undegraded":"2024-09-13T11:15:29.885612+0000","last_fullsized":"2024-09-13T11:15:29.885612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9115,"log_dups_size":0,"ondisk_log_size":9115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:21:41.221566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9109,"num_write_kb":263300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'6180","reported_seq":6202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:32.438148+0000","last_change":"2024-09-13T11:12:05.718373+0000","last_active":"2024-09-13T11:15:32.438148+0000","last_peered":"2024-09-13T11:15:32.438148+0000","last_clean":"2024-09-13T11:15:32.438148+0000","last_became_active":"2024-09-13T11:12:05.718074+0000","last_became_peered":"2024-09-13T11:12:05.718074+0000","last_unstale":"2024-09-13T11:15:32.438148+0000","last_undegraded":"2024-09-13T11:15:32.438148+0000","last_fullsized":"2024-09-13T11:15:32.438148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:42.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":6189,"num_write_kb":150954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'3312","reported_seq":3330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197817+0000","last_change":"2024-09-13T11:12:05.719775+0000","last_active":"2024-09-13T11:16:29.197817+0000","last_peered":"2024-09-13T11:16:29.197817+0000","last_clean":"2024-09-13T11:16:29.197817+0000","last_became_active":"2024-09-13T11:12:05.716472+0000","last_became_peered":"2024-09-13T11:12:05.716472+0000","last_unstale":"2024-09-13T11:16:29.197817+0000","last_undegraded":"2024-09-13T11:16:29.197817+0000","last_fullsized":"2024-09-13T11:16:29.197817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:12.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85395112,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3286,"num_write_kb":133748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'6541","reported_seq":6562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171301+0000","last_change":"2024-09-13T11:12:05.723073+0000","last_active":"2024-09-13T11:16:29.171301+0000","last_peered":"2024-09-13T11:16:29.171301+0000","last_clean":"2024-09-13T11:16:29.171301+0000","last_became_active":"2024-09-13T11:12:05.722294+0000","last_became_peered":"2024-09-13T11:12:05.722294+0000","last_unstale":"2024-09-13T11:16:29.171301+0000","last_undegraded":"2024-09-13T11:16:29.171301+0000","last_fullsized":"2024-09-13T11:16:29.171301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6541,"log_dups_size":0,"ondisk_log_size":6541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:16.657467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6545,"num_write_kb":158257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'6358","reported_seq":6375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.152232+0000","last_change":"2024-09-13T11:12:05.714322+0000","last_active":"2024-09-13T11:16:29.152232+0000","last_peered":"2024-09-13T11:16:29.152232+0000","last_clean":"2024-09-13T11:16:29.152232+0000","last_became_active":"2024-09-13T11:12:05.713307+0000","last_became_peered":"2024-09-13T11:12:05.713307+0000","last_unstale":"2024-09-13T11:16:29.152232+0000","last_undegraded":"2024-09-13T11:16:29.152232+0000","last_fullsized":"2024-09-13T11:16:29.152232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6358,"log_dups_size":0,"ondisk_log_size":6358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:57.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":215299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.307796+0000","last_change":"2024-09-13T11:11:59.264383+0000","last_active":"2024-09-13T11:15:13.307796+0000","last_peered":"2024-09-13T11:15:13.307796+0000","last_clean":"2024-09-13T11:15:13.307796+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:15:13.307796+0000","last_undegraded":"2024-09-13T11:15:13.307796+0000","last_fullsized":"2024-09-13T11:15:13.307796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:19.549032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'6805","reported_seq":6848,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:34.198516+0000","last_change":"2024-09-13T11:12:05.707737+0000","last_active":"2024-09-13T11:15:34.198516+0000","last_peered":"2024-09-13T11:15:34.198516+0000","last_clean":"2024-09-13T11:15:34.198516+0000","last_became_active":"2024-09-13T11:12:05.707378+0000","last_became_peered":"2024-09-13T11:12:05.707378+0000","last_unstale":"2024-09-13T11:15:34.198516+0000","last_undegraded":"2024-09-13T11:15:34.198516+0000","last_fullsized":"2024-09-13T11:15:34.198516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6805,"log_dups_size":0,"ondisk_log_size":6805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:27.559821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":6821,"num_write_kb":193336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.323787+0000","last_change":"2024-09-13T11:11:59.170926+0000","last_active":"2024-09-13T11:15:13.323787+0000","last_peered":"2024-09-13T11:15:13.323787+0000","last_clean":"2024-09-13T11:15:13.323787+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:15:13.323787+0000","last_undegraded":"2024-09-13T11:15:13.323787+0000","last_fullsized":"2024-09-13T11:15:13.323787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:28.792477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'4653","reported_seq":4680,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.777443+0000","last_change":"2024-09-13T11:12:05.711115+0000","last_active":"2024-09-13T11:15:13.777443+0000","last_peered":"2024-09-13T11:15:13.777443+0000","last_clean":"2024-09-13T11:15:13.777443+0000","last_became_active":"2024-09-13T11:12:05.710876+0000","last_became_peered":"2024-09-13T11:12:05.710876+0000","last_unstale":"2024-09-13T11:15:13.777443+0000","last_undegraded":"2024-09-13T11:15:13.777443+0000","last_fullsized":"2024-09-13T11:15:13.777443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:43.433333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107063120,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":4630,"num_write_kb":171206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.172123+0000","last_change":"2024-09-13T11:11:59.264364+0000","last_active":"2024-09-13T11:16:29.172123+0000","last_peered":"2024-09-13T11:16:29.172123+0000","last_clean":"2024-09-13T11:16:29.172123+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:16:29.172123+0000","last_undegraded":"2024-09-13T11:16:29.172123+0000","last_fullsized":"2024-09-13T11:16:29.172123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:46.598343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8136","reported_seq":8158,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:31.838203+0000","last_change":"2024-09-13T11:12:05.889138+0000","last_active":"2024-09-13T11:15:31.838203+0000","last_peered":"2024-09-13T11:15:31.838203+0000","last_clean":"2024-09-13T11:15:31.838203+0000","last_became_active":"2024-09-13T11:12:05.888409+0000","last_became_peered":"2024-09-13T11:12:05.888409+0000","last_unstale":"2024-09-13T11:15:31.838203+0000","last_undegraded":"2024-09-13T11:15:31.838203+0000","last_fullsized":"2024-09-13T11:15:31.838203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8136,"log_dups_size":0,"ondisk_log_size":8136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:16.890148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543104,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":8142,"num_write_kb":253572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.323610+0000","last_change":"2024-09-13T11:11:59.171084+0000","last_active":"2024-09-13T11:15:13.323610+0000","last_peered":"2024-09-13T11:15:13.323610+0000","last_clean":"2024-09-13T11:15:13.323610+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:15:13.323610+0000","last_undegraded":"2024-09-13T11:15:13.323610+0000","last_fullsized":"2024-09-13T11:15:13.323610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:01.700221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'4755","reported_seq":4774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197667+0000","last_change":"2024-09-13T11:12:05.729028+0000","last_active":"2024-09-13T11:16:29.197667+0000","last_peered":"2024-09-13T11:16:29.197667+0000","last_clean":"2024-09-13T11:16:29.197667+0000","last_became_active":"2024-09-13T11:12:05.726919+0000","last_became_peered":"2024-09-13T11:12:05.726919+0000","last_unstale":"2024-09-13T11:16:29.197667+0000","last_undegraded":"2024-09-13T11:16:29.197667+0000","last_fullsized":"2024-09-13T11:16:29.197667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:42.310569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4753,"num_write_kb":177157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'6488","reported_seq":6831,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151891+0000","last_change":"2024-09-13T11:12:05.724178+0000","last_active":"2024-09-13T11:16:29.151891+0000","last_peered":"2024-09-13T11:16:29.151891+0000","last_clean":"2024-09-13T11:16:29.151891+0000","last_became_active":"2024-09-13T11:12:05.715353+0000","last_became_peered":"2024-09-13T11:12:05.715353+0000","last_unstale":"2024-09-13T11:16:29.151891+0000","last_undegraded":"2024-09-13T11:16:29.151891+0000","last_fullsized":"2024-09-13T11:16:29.151891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6488,"log_dups_size":0,"ondisk_log_size":6488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:39:43.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1078,"num_read_kb":960,"num_write":6740,"num_write_kb":218838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196274+0000","last_change":"2024-09-13T11:11:59.177551+0000","last_active":"2024-09-13T11:16:29.196274+0000","last_peered":"2024-09-13T11:16:29.196274+0000","last_clean":"2024-09-13T11:16:29.196274+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:16:29.196274+0000","last_undegraded":"2024-09-13T11:16:29.196274+0000","last_fullsized":"2024-09-13T11:16:29.196274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:06.698959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"24'3583","reported_seq":3600,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.768120+0000","last_change":"2024-09-13T11:12:05.890104+0000","last_active":"2024-09-13T11:15:13.768120+0000","last_peered":"2024-09-13T11:15:13.768120+0000","last_clean":"2024-09-13T11:15:13.768120+0000","last_became_active":"2024-09-13T11:12:05.889331+0000","last_became_peered":"2024-09-13T11:12:05.889331+0000","last_unstale":"2024-09-13T11:15:13.768120+0000","last_undegraded":"2024-09-13T11:15:13.768120+0000","last_fullsized":"2024-09-13T11:15:13.768120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3583,"log_dups_size":0,"ondisk_log_size":3583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:36.750096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3535,"num_write_kb":168833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.318703+0000","last_change":"2024-09-13T11:11:59.262864+0000","last_active":"2024-09-13T11:15:13.318703+0000","last_peered":"2024-09-13T11:15:13.318703+0000","last_clean":"2024-09-13T11:15:13.318703+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:15:13.318703+0000","last_undegraded":"2024-09-13T11:15:13.318703+0000","last_fullsized":"2024-09-13T11:15:13.318703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:49.061602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'3817","reported_seq":3834,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.771059+0000","last_change":"2024-09-13T11:12:05.716843+0000","last_active":"2024-09-13T11:15:13.771059+0000","last_peered":"2024-09-13T11:15:13.771059+0000","last_clean":"2024-09-13T11:15:13.771059+0000","last_became_active":"2024-09-13T11:12:05.716555+0000","last_became_peered":"2024-09-13T11:12:05.716555+0000","last_unstale":"2024-09-13T11:15:13.771059+0000","last_undegraded":"2024-09-13T11:15:13.771059+0000","last_fullsized":"2024-09-13T11:15:13.771059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3817,"log_dups_size":0,"ondisk_log_size":3817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:33.343050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":161030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171199+0000","last_change":"2024-09-13T11:11:59.264363+0000","last_active":"2024-09-13T11:16:29.171199+0000","last_peered":"2024-09-13T11:16:29.171199+0000","last_clean":"2024-09-13T11:16:29.171199+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:16:29.171199+0000","last_undegraded":"2024-09-13T11:16:29.171199+0000","last_fullsized":"2024-09-13T11:16:29.171199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:02.989025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'5147","reported_seq":5183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:26.496646+0000","last_change":"2024-09-13T11:12:05.717945+0000","last_active":"2024-09-13T11:15:26.496646+0000","last_peered":"2024-09-13T11:15:26.496646+0000","last_clean":"2024-09-13T11:15:26.496646+0000","last_became_active":"2024-09-13T11:12:05.717715+0000","last_became_peered":"2024-09-13T11:12:05.717715+0000","last_unstale":"2024-09-13T11:15:26.496646+0000","last_undegraded":"2024-09-13T11:15:26.496646+0000","last_fullsized":"2024-09-13T11:15:26.496646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5147,"log_dups_size":0,"ondisk_log_size":5147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:00:42.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":5176,"num_write_kb":147263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196089+0000","last_change":"2024-09-13T11:11:59.175526+0000","last_active":"2024-09-13T11:16:29.196089+0000","last_peered":"2024-09-13T11:16:29.196089+0000","last_clean":"2024-09-13T11:16:29.196089+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:16:29.196089+0000","last_undegraded":"2024-09-13T11:16:29.196089+0000","last_fullsized":"2024-09-13T11:16:29.196089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:13.643417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171211+0000","last_change":"2024-09-13T11:11:49.099967+0000","last_active":"2024-09-13T11:16:29.171211+0000","last_peered":"2024-09-13T11:16:29.171211+0000","last_clean":"2024-09-13T11:16:29.171211+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:16:29.171211+0000","last_undegraded":"2024-09-13T11:16:29.171211+0000","last_fullsized":"2024-09-13T11:16:29.171211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_clean_scrub_stamp":"2024-09-13T11:11:48.073845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:02.753349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"24'2972","reported_seq":2998,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.772941+0000","last_change":"2024-09-13T11:12:05.700433+0000","last_active":"2024-09-13T11:15:13.772941+0000","last_peered":"2024-09-13T11:15:13.772941+0000","last_clean":"2024-09-13T11:15:13.772941+0000","last_became_active":"2024-09-13T11:12:05.700153+0000","last_became_peered":"2024-09-13T11:12:05.700153+0000","last_unstale":"2024-09-13T11:15:13.772941+0000","last_undegraded":"2024-09-13T11:15:13.772941+0000","last_fullsized":"2024-09-13T11:15:13.772941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2972,"log_dups_size":0,"ondisk_log_size":2972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:13.356022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104988672,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":2914,"num_write_kb":144131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'8252","reported_seq":8395,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.241374+0000","last_change":"2024-09-13T11:12:05.888680+0000","last_active":"2024-09-13T11:16:29.241374+0000","last_peered":"2024-09-13T11:16:29.241374+0000","last_clean":"2024-09-13T11:16:29.241374+0000","last_became_active":"2024-09-13T11:12:05.888170+0000","last_became_peered":"2024-09-13T11:12:05.888170+0000","last_unstale":"2024-09-13T11:16:29.241374+0000","last_undegraded":"2024-09-13T11:16:29.241374+0000","last_fullsized":"2024-09-13T11:16:29.241374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8252,"log_dups_size":0,"ondisk_log_size":8252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:46:22.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114688000,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":430,"num_read_kb":380,"num_write":6298,"num_write_kb":189330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"24'5168","reported_seq":5188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:31.760296+0000","last_change":"2024-09-13T11:12:05.727588+0000","last_active":"2024-09-13T11:15:31.760296+0000","last_peered":"2024-09-13T11:15:31.760296+0000","last_clean":"2024-09-13T11:15:31.760296+0000","last_became_active":"2024-09-13T11:12:05.726759+0000","last_became_peered":"2024-09-13T11:12:05.726759+0000","last_unstale":"2024-09-13T11:15:31.760296+0000","last_undegraded":"2024-09-13T11:15:31.760296+0000","last_fullsized":"2024-09-13T11:15:31.760296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5168,"log_dups_size":0,"ondisk_log_size":5168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:38.027194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":5148,"num_write_kb":185606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'4264","reported_seq":4292,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.387902+0000","last_change":"2024-09-13T11:12:05.709828+0000","last_active":"2024-09-13T11:15:13.387902+0000","last_peered":"2024-09-13T11:15:13.387902+0000","last_clean":"2024-09-13T11:15:13.387902+0000","last_became_active":"2024-09-13T11:12:05.709368+0000","last_became_peered":"2024-09-13T11:12:05.709368+0000","last_unstale":"2024-09-13T11:15:13.387902+0000","last_undegraded":"2024-09-13T11:15:13.387902+0000","last_fullsized":"2024-09-13T11:15:13.387902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":0,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.129402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121635328,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":4285,"num_write_kb":189832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'4764","reported_seq":4788,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196993+0000","last_change":"2024-09-13T11:12:05.719371+0000","last_active":"2024-09-13T11:16:29.196993+0000","last_peered":"2024-09-13T11:16:29.196993+0000","last_clean":"2024-09-13T11:16:29.196993+0000","last_became_active":"2024-09-13T11:12:05.716884+0000","last_became_peered":"2024-09-13T11:12:05.716884+0000","last_unstale":"2024-09-13T11:16:29.196993+0000","last_undegraded":"2024-09-13T11:16:29.196993+0000","last_fullsized":"2024-09-13T11:16:29.196993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:34.250313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130220552,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":27,"num_read_kb":83,"num_write":4732,"num_write_kb":234695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3101","reported_seq":3135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171732+0000","last_change":"2024-09-13T11:12:05.731406+0000","last_active":"2024-09-13T11:16:29.171732+0000","last_peered":"2024-09-13T11:16:29.171732+0000","last_clean":"2024-09-13T11:16:29.171732+0000","last_became_active":"2024-09-13T11:12:05.730642+0000","last_became_peered":"2024-09-13T11:12:05.730642+0000","last_unstale":"2024-09-13T11:16:29.171732+0000","last_undegraded":"2024-09-13T11:16:29.171732+0000","last_fullsized":"2024-09-13T11:16:29.171732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3101,"log_dups_size":0,"ondisk_log_size":3101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:34.115785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98697744,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":61,"num_read_kb":48,"num_write":3111,"num_write_kb":136971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'4813","reported_seq":4935,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.214604+0000","last_change":"2024-09-13T11:12:05.731761+0000","last_active":"2024-09-13T11:16:29.214604+0000","last_peered":"2024-09-13T11:16:29.214604+0000","last_clean":"2024-09-13T11:16:29.214604+0000","last_became_active":"2024-09-13T11:12:05.731054+0000","last_became_peered":"2024-09-13T11:12:05.731054+0000","last_unstale":"2024-09-13T11:16:29.214604+0000","last_undegraded":"2024-09-13T11:16:29.214604+0000","last_fullsized":"2024-09-13T11:16:29.214604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4813,"log_dups_size":0,"ondisk_log_size":4813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:45.840805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120398352,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":345,"num_read_kb":457,"num_write":5199,"num_write_kb":163956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'5304","reported_seq":5322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.246195+0000","last_change":"2024-09-13T11:12:05.723811+0000","last_active":"2024-09-13T11:16:29.246195+0000","last_peered":"2024-09-13T11:16:29.246195+0000","last_clean":"2024-09-13T11:16:29.246195+0000","last_became_active":"2024-09-13T11:12:05.722874+0000","last_became_peered":"2024-09-13T11:12:05.722874+0000","last_unstale":"2024-09-13T11:16:29.246195+0000","last_undegraded":"2024-09-13T11:16:29.246195+0000","last_fullsized":"2024-09-13T11:16:29.246195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5304,"log_dups_size":0,"ondisk_log_size":5304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.959449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148860928,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":228833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"24'2493","reported_seq":2511,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.763829+0000","last_change":"2024-09-13T11:12:05.713322+0000","last_active":"2024-09-13T11:15:13.763829+0000","last_peered":"2024-09-13T11:15:13.763829+0000","last_clean":"2024-09-13T11:15:13.763829+0000","last_became_active":"2024-09-13T11:12:05.712482+0000","last_became_peered":"2024-09-13T11:12:05.712482+0000","last_unstale":"2024-09-13T11:15:13.763829+0000","last_undegraded":"2024-09-13T11:15:13.763829+0000","last_fullsized":"2024-09-13T11:15:13.763829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2493,"log_dups_size":0,"ondisk_log_size":2493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:50.799467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497984,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2455,"num_write_kb":115332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4070","reported_seq":4090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171469+0000","last_change":"2024-09-13T11:12:05.729681+0000","last_active":"2024-09-13T11:16:29.171469+0000","last_peered":"2024-09-13T11:16:29.171469+0000","last_clean":"2024-09-13T11:16:29.171469+0000","last_became_active":"2024-09-13T11:12:05.728964+0000","last_became_peered":"2024-09-13T11:12:05.728964+0000","last_unstale":"2024-09-13T11:16:29.171469+0000","last_undegraded":"2024-09-13T11:16:29.171469+0000","last_fullsized":"2024-09-13T11:16:29.171469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:54.843915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99232096,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":4074,"num_write_kb":180077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'3595","reported_seq":3616,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.764513+0000","last_change":"2024-09-13T11:12:05.720869+0000","last_active":"2024-09-13T11:15:13.764513+0000","last_peered":"2024-09-13T11:15:13.764513+0000","last_clean":"2024-09-13T11:15:13.764513+0000","last_became_active":"2024-09-13T11:12:05.720600+0000","last_became_peered":"2024-09-13T11:12:05.720600+0000","last_unstale":"2024-09-13T11:15:13.764513+0000","last_undegraded":"2024-09-13T11:15:13.764513+0000","last_fullsized":"2024-09-13T11:15:13.764513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:58:51.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":152845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'9050","reported_seq":9082,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171396+0000","last_change":"2024-09-13T11:12:05.731290+0000","last_active":"2024-09-13T11:16:29.171396+0000","last_peered":"2024-09-13T11:16:29.171396+0000","last_clean":"2024-09-13T11:16:29.171396+0000","last_became_active":"2024-09-13T11:12:05.729859+0000","last_became_peered":"2024-09-13T11:12:05.729859+0000","last_unstale":"2024-09-13T11:16:29.171396+0000","last_undegraded":"2024-09-13T11:16:29.171396+0000","last_fullsized":"2024-09-13T11:16:29.171396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9050,"log_dups_size":0,"ondisk_log_size":9050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:53:12.549090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":9057,"num_write_kb":215054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3578757896,"num_objects":881,"num_object_clones":0,"num_object_copies":1762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":2554,"num_read_kb":2565,"num_write":162763,"num_write_kb":5648753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7157350400,"data_stored":7157253648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164516,"ondisk_log_size":164516,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286328,"kb_used_data":1102504,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93085512,"statfs":{"total":96636764160,"available":95319564288,"internally_reserved":0,"allocated":1128964096,"data_stored":1128781606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":188217803},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077852,"kb_used_data":916236,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":93293988,"statfs":{"total":96636764160,"available":95533043712,"internally_reserved":0,"allocated":938225664,"data_stored":938048425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1685516,"kb_used_data":1437884,"kb_used_omap":1,"kb_used_meta":247614,"kb_avail":92686324,"statfs":{"total":96636764160,"available":94910795776,"internally_reserved":0,"allocated":1472393216,"data_stored":1472211750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253557189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429572,"kb_used_data":349876,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":93942268,"statfs":{"total":96636764160,"available":96196882432,"internally_reserved":0,"allocated":358273024,"data_stored":358115198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765328,"kb_used_data":635648,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":93606512,"statfs":{"total":96636764160,"available":95853068288,"internally_reserved":0,"allocated":650903552,"data_stored":650734513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361036,"kb_used_data":303484,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94010804,"statfs":{"total":96636764160,"available":96267063296,"internally_reserved":0,"allocated":310767616,"data_stored":310602622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1312892,"kb_used_data":1137388,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":93058948,"statfs":{"total":96636764160,"available":95292362752,"internally_reserved":0,"allocated":1164685312,"data_stored":1164514518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179698119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1289364,"kb_used_data":1109700,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":93082476,"statfs":{"total":96636764160,"available":95316455424,"internally_reserved":0,"allocated":1136332800,"data_stored":1136162030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1135489024,"data_stored":1135479632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":650649600,"data_stored":650642464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":358023168,"data_stored":358023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1164435456,"data_stored":1164422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1472143360,"data_stored":1472119720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":937971712,"data_stored":937956376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":310517760,"data_stored":310510592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1128120320,"data_stored":1128099208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:16:30.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T11:16:30.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:16:30.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.597+0000 7f6a98c3b640 1 Processor -- start 2024-09-13T11:16:30.604 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.597+0000 7f6a98c3b640 1 -- start start 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6a940aac00 0x7f6a941422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 0x7f6a94140b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a94141070 0x7f6a94071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6a94141d90 con 0x7f6a940aafe0 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6a941427f0 con 0x7f6a940aac00 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f6a940aa6d0 con 0x7f6a94141070 2024-09-13T11:16:30.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a91d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 0x7f6a94140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a94141070 0x7f6a94071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a91d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 0x7f6a94140b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35846/0 (socket says 172.21.15.39:35846) 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a91d9b640 1 -- 172.21.15.39:0/1662096608 learned_addr learned my addr 172.21.15.39:0/1662096608 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a9259c640 1 --2- 172.21.15.39:0/1662096608 >> v2:172.21.15.102:3300/0 conn(0x7f6a940aac00 0x7f6a941422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 -- 172.21.15.39:0/1662096608 >> v2:172.21.15.102:3300/0 conn(0x7f6a940aac00 msgr2=0x7f6a941422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 --2- 172.21.15.39:0/1662096608 >> v2:172.21.15.102:3300/0 conn(0x7f6a940aac00 0x7f6a941422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 -- 172.21.15.39:0/1662096608 >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 msgr2=0x7f6a94140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 --2- 172.21.15.39:0/1662096608 >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 0x7f6a94140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 -- 172.21.15.39:0/1662096608 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a940ab500 con 0x7f6a94141070 2024-09-13T11:16:30.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a91d9b640 1 --2- 172.21.15.39:0/1662096608 >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 0x7f6a94140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a92d9d640 1 --2- 172.21.15.39:0/1662096608 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a94141070 0x7f6a94071a20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a94069c10 tx=0x7f6a8c01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43e337b3e530409e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a9159a640 1 -- 172.21.15.39:0/1662096608 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0b0070 con 0x7f6a94141070 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a9159a640 1 -- 172.21.15.39:0/1662096608 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c0ab600 con 0x7f6a94141070 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a9159a640 1 -- 172.21.15.39:0/1662096608 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0ab9d0 con 0x7f6a94141070 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- 172.21.15.39:0/1662096608 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a94141070 msgr2=0x7f6a94071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/1662096608 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a94141070 0x7f6a94071a20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6a94069c10 tx=0x7f6a8c01c3d0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- 172.21.15.39:0/1662096608 shutdown_connections 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/1662096608 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a94141070 0x7f6a94071a20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/1662096608 >> v2:172.21.15.39:3300/0 conn(0x7f6a940aafe0 0x7f6a94140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/1662096608 >> v2:172.21.15.102:3300/0 conn(0x7f6a940aac00 0x7f6a941422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- 172.21.15.39:0/1662096608 >> 172.21.15.39:0/1662096608 conn(0x7f6a940b7a70 msgr2=0x7f6a940b7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:30.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- 172.21.15.39:0/1662096608 shutdown_connections 2024-09-13T11:16:30.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.601+0000 7f6a98c3b640 1 -- 172.21.15.39:0/1662096608 wait complete. 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 Processor -- start 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- start start 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a940aac00 0x7f6a9413c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 0x7f6a9413a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94141070 0x7f6a9413d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94145800 con 0x7f6a94141070 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94145680 con 0x7f6a940aac00 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f6a94145980 con 0x7f6a940aafe0 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a92d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94141070 0x7f6a9413d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 0x7f6a9413a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.611 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 0x7f6a9413a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57250/0 (socket says 172.21.15.39:57250) 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 -- 172.21.15.39:0/3212423374 learned_addr learned my addr 172.21.15.39:0/3212423374 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 -- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a940aac00 msgr2=0x7f6a9413c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a9259c640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a940aac00 0x7f6a9413c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a940aac00 0x7f6a9413c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 -- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94141070 msgr2=0x7f6a9413d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94141070 0x7f6a9413d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 -- 172.21.15.39:0/3212423374 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a94146be0 con 0x7f6a940aafe0 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a92d9d640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94141070 0x7f6a9413d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a91d9b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 0x7f6a9413a070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009f20 tx=0x7f6a8400c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84014480 con 0x7f6a940aafe0 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a84019070 con 0x7f6a940aafe0 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84014820 con 0x7f6a940aafe0 2024-09-13T11:16:30.612 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9414ab00 con 0x7f6a940aafe0 2024-09-13T11:16:30.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9413afe0 con 0x7f6a940aafe0 2024-09-13T11:16:30.613 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.605+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a941469d0 con 0x7f6a940aafe0 2024-09-13T11:16:30.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.609+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f6a84012050 con 0x7f6a940aafe0 2024-09-13T11:16:30.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.609+0000 7f6a8affd640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f6a74072100 0x7f6a740745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.609+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f6a84092e70 con 0x7f6a940aafe0 2024-09-13T11:16:30.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.609+0000 7f6a9259c640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f6a74072100 0x7f6a740745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.614 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.609+0000 7f6a9259c640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f6a74072100 0x7f6a740745c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009710 tx=0x7f6a7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.613+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6a84010040 con 0x7f6a940aafe0 2024-09-13T11:16:30.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.781+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a9413ff60 con 0x7f6a74072100 2024-09-13T11:16:30.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.785+0000 7f6a8affd640 1 -- 172.21.15.39:0/3212423374 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117465 (secure 0 0 0) 0x7f6a9413ff60 con 0x7f6a74072100 2024-09-13T11:16:30.792 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:16:30.793 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:16:30.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f6a74072100 msgr2=0x7f6a740745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f6a74072100 0x7f6a740745c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009710 tx=0x7f6a7c008040 comp rx=0 tx=0).stop 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 msgr2=0x7f6a9413a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 0x7f6a9413a070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009f20 tx=0x7f6a8400c550 comp rx=0 tx=0).stop 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 shutdown_connections 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f6a74072100 0x7f6a740745c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6a94141070 0x7f6a9413d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6a940aafe0 0x7f6a9413a070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 --2- 172.21.15.39:0/3212423374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a940aac00 0x7f6a9413c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 >> 172.21.15.39:0/3212423374 conn(0x7f6a940b7a70 msgr2=0x7f6a940b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 shutdown_connections 2024-09-13T11:16:30.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.789+0000 7f6a98c3b640 1 -- 172.21.15.39:0/3212423374 wait complete. 2024-09-13T11:16:30.811 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T11:16:30.065413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3579348283,"num_objects":885,"num_object_clones":0,"num_object_copies":1770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":885,"num_whiteouts":0,"num_read":2620,"num_read_kb":2620,"num_write":162866,"num_write_kb":5650383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164591,"ondisk_log_size":164591,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8207888,"kb_used_data":6992720,"kb_used_omap":12,"kb_used_meta":1215027,"kb_avail":746766832,"statfs":{"total":773094113280,"available":764689235968,"internally_reserved":0,"allocated":7160545280,"data_stored":7159170662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1244188209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003592"},"pg_stats":[{"pgid":"3.1f","version":"23'3476","reported_seq":3493,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.393000+0000","last_change":"2024-09-13T11:12:05.719358+0000","last_active":"2024-09-13T11:15:13.393000+0000","last_peered":"2024-09-13T11:15:13.393000+0000","last_clean":"2024-09-13T11:15:13.393000+0000","last_became_active":"2024-09-13T11:12:05.719081+0000","last_became_peered":"2024-09-13T11:12:05.719081+0000","last_unstale":"2024-09-13T11:15:13.393000+0000","last_undegraded":"2024-09-13T11:15:13.393000+0000","last_fullsized":"2024-09-13T11:15:13.393000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3476,"log_dups_size":0,"ondisk_log_size":3476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:56.858667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90834768,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":159322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"24'5688","reported_seq":5713,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:20.470892+0000","last_change":"2024-09-13T11:12:05.710129+0000","last_active":"2024-09-13T11:15:20.470892+0000","last_peered":"2024-09-13T11:15:20.470892+0000","last_clean":"2024-09-13T11:15:20.470892+0000","last_became_active":"2024-09-13T11:12:05.709855+0000","last_became_peered":"2024-09-13T11:12:05.709855+0000","last_unstale":"2024-09-13T11:15:20.470892+0000","last_undegraded":"2024-09-13T11:15:20.470892+0000","last_fullsized":"2024-09-13T11:15:20.470892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5688,"log_dups_size":0,"ondisk_log_size":5688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:54.761992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117572096,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":28,"num_read_kb":84,"num_write":5683,"num_write_kb":165192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4915","reported_seq":4941,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197798+0000","last_change":"2024-09-13T11:12:05.730996+0000","last_active":"2024-09-13T11:16:29.197798+0000","last_peered":"2024-09-13T11:16:29.197798+0000","last_clean":"2024-09-13T11:16:29.197798+0000","last_became_active":"2024-09-13T11:12:05.730262+0000","last_became_peered":"2024-09-13T11:12:05.730262+0000","last_unstale":"2024-09-13T11:16:29.197798+0000","last_undegraded":"2024-09-13T11:16:29.197798+0000","last_fullsized":"2024-09-13T11:16:29.197798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4915,"log_dups_size":0,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:17.111335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":4903,"num_write_kb":132100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4411","reported_seq":4430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196379+0000","last_change":"2024-09-13T11:12:05.728308+0000","last_active":"2024-09-13T11:16:29.196379+0000","last_peered":"2024-09-13T11:16:29.196379+0000","last_clean":"2024-09-13T11:16:29.196379+0000","last_became_active":"2024-09-13T11:12:05.727615+0000","last_became_peered":"2024-09-13T11:12:05.727615+0000","last_unstale":"2024-09-13T11:16:29.196379+0000","last_undegraded":"2024-09-13T11:16:29.196379+0000","last_fullsized":"2024-09-13T11:16:29.196379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:49.921089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117506568,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4416,"num_write_kb":182807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"24'2876","reported_seq":2892,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.767458+0000","last_change":"2024-09-13T11:12:05.726002+0000","last_active":"2024-09-13T11:15:13.767458+0000","last_peered":"2024-09-13T11:15:13.767458+0000","last_clean":"2024-09-13T11:15:13.767458+0000","last_became_active":"2024-09-13T11:12:05.725707+0000","last_became_peered":"2024-09-13T11:12:05.725707+0000","last_unstale":"2024-09-13T11:15:13.767458+0000","last_undegraded":"2024-09-13T11:15:13.767458+0000","last_fullsized":"2024-09-13T11:15:13.767458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2876,"log_dups_size":0,"ondisk_log_size":2876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:18:45.458853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2825,"num_write_kb":115717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'4755","reported_seq":4877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151751+0000","last_change":"2024-09-13T11:12:05.707268+0000","last_active":"2024-09-13T11:16:29.151751+0000","last_peered":"2024-09-13T11:16:29.151751+0000","last_clean":"2024-09-13T11:16:29.151751+0000","last_became_active":"2024-09-13T11:12:05.706491+0000","last_became_peered":"2024-09-13T11:12:05.706491+0000","last_unstale":"2024-09-13T11:16:29.151751+0000","last_undegraded":"2024-09-13T11:16:29.151751+0000","last_fullsized":"2024-09-13T11:16:29.151751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:36.756608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58983456,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":4748,"num_write_kb":132323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"24'5659","reported_seq":5679,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:29.327921+0000","last_change":"2024-09-13T11:12:05.705309+0000","last_active":"2024-09-13T11:15:29.327921+0000","last_peered":"2024-09-13T11:15:29.327921+0000","last_clean":"2024-09-13T11:15:29.327921+0000","last_became_active":"2024-09-13T11:12:05.704854+0000","last_became_peered":"2024-09-13T11:12:05.704854+0000","last_unstale":"2024-09-13T11:15:29.327921+0000","last_undegraded":"2024-09-13T11:15:29.327921+0000","last_fullsized":"2024-09-13T11:15:29.327921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5659,"log_dups_size":0,"ondisk_log_size":5659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:16.712542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":5619,"num_write_kb":211837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'9115","reported_seq":9131,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:29.885612+0000","last_change":"2024-09-13T11:12:05.708931+0000","last_active":"2024-09-13T11:15:29.885612+0000","last_peered":"2024-09-13T11:15:29.885612+0000","last_clean":"2024-09-13T11:15:29.885612+0000","last_became_active":"2024-09-13T11:12:05.708741+0000","last_became_peered":"2024-09-13T11:12:05.708741+0000","last_unstale":"2024-09-13T11:15:29.885612+0000","last_undegraded":"2024-09-13T11:15:29.885612+0000","last_fullsized":"2024-09-13T11:15:29.885612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9115,"log_dups_size":0,"ondisk_log_size":9115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:21:41.221566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9109,"num_write_kb":263300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'6180","reported_seq":6202,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:32.438148+0000","last_change":"2024-09-13T11:12:05.718373+0000","last_active":"2024-09-13T11:15:32.438148+0000","last_peered":"2024-09-13T11:15:32.438148+0000","last_clean":"2024-09-13T11:15:32.438148+0000","last_became_active":"2024-09-13T11:12:05.718074+0000","last_became_peered":"2024-09-13T11:12:05.718074+0000","last_unstale":"2024-09-13T11:15:32.438148+0000","last_undegraded":"2024-09-13T11:15:32.438148+0000","last_fullsized":"2024-09-13T11:15:32.438148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:42.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":6189,"num_write_kb":150954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'3312","reported_seq":3330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197817+0000","last_change":"2024-09-13T11:12:05.719775+0000","last_active":"2024-09-13T11:16:29.197817+0000","last_peered":"2024-09-13T11:16:29.197817+0000","last_clean":"2024-09-13T11:16:29.197817+0000","last_became_active":"2024-09-13T11:12:05.716472+0000","last_became_peered":"2024-09-13T11:12:05.716472+0000","last_unstale":"2024-09-13T11:16:29.197817+0000","last_undegraded":"2024-09-13T11:16:29.197817+0000","last_fullsized":"2024-09-13T11:16:29.197817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:12.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85395112,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3286,"num_write_kb":133748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'6541","reported_seq":6562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171301+0000","last_change":"2024-09-13T11:12:05.723073+0000","last_active":"2024-09-13T11:16:29.171301+0000","last_peered":"2024-09-13T11:16:29.171301+0000","last_clean":"2024-09-13T11:16:29.171301+0000","last_became_active":"2024-09-13T11:12:05.722294+0000","last_became_peered":"2024-09-13T11:12:05.722294+0000","last_unstale":"2024-09-13T11:16:29.171301+0000","last_undegraded":"2024-09-13T11:16:29.171301+0000","last_fullsized":"2024-09-13T11:16:29.171301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6541,"log_dups_size":0,"ondisk_log_size":6541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:16.657467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6545,"num_write_kb":158257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'6358","reported_seq":6375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.152232+0000","last_change":"2024-09-13T11:12:05.714322+0000","last_active":"2024-09-13T11:16:29.152232+0000","last_peered":"2024-09-13T11:16:29.152232+0000","last_clean":"2024-09-13T11:16:29.152232+0000","last_became_active":"2024-09-13T11:12:05.713307+0000","last_became_peered":"2024-09-13T11:12:05.713307+0000","last_unstale":"2024-09-13T11:16:29.152232+0000","last_undegraded":"2024-09-13T11:16:29.152232+0000","last_fullsized":"2024-09-13T11:16:29.152232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6358,"log_dups_size":0,"ondisk_log_size":6358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:57.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":215299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.307796+0000","last_change":"2024-09-13T11:11:59.264383+0000","last_active":"2024-09-13T11:15:13.307796+0000","last_peered":"2024-09-13T11:15:13.307796+0000","last_clean":"2024-09-13T11:15:13.307796+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:15:13.307796+0000","last_undegraded":"2024-09-13T11:15:13.307796+0000","last_fullsized":"2024-09-13T11:15:13.307796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:19.549032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'6805","reported_seq":6848,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:34.198516+0000","last_change":"2024-09-13T11:12:05.707737+0000","last_active":"2024-09-13T11:15:34.198516+0000","last_peered":"2024-09-13T11:15:34.198516+0000","last_clean":"2024-09-13T11:15:34.198516+0000","last_became_active":"2024-09-13T11:12:05.707378+0000","last_became_peered":"2024-09-13T11:12:05.707378+0000","last_unstale":"2024-09-13T11:15:34.198516+0000","last_undegraded":"2024-09-13T11:15:34.198516+0000","last_fullsized":"2024-09-13T11:15:34.198516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6805,"log_dups_size":0,"ondisk_log_size":6805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:54:27.559821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":6821,"num_write_kb":193336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.323787+0000","last_change":"2024-09-13T11:11:59.170926+0000","last_active":"2024-09-13T11:15:13.323787+0000","last_peered":"2024-09-13T11:15:13.323787+0000","last_clean":"2024-09-13T11:15:13.323787+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:15:13.323787+0000","last_undegraded":"2024-09-13T11:15:13.323787+0000","last_fullsized":"2024-09-13T11:15:13.323787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:28.792477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'4653","reported_seq":4680,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.777443+0000","last_change":"2024-09-13T11:12:05.711115+0000","last_active":"2024-09-13T11:15:13.777443+0000","last_peered":"2024-09-13T11:15:13.777443+0000","last_clean":"2024-09-13T11:15:13.777443+0000","last_became_active":"2024-09-13T11:12:05.710876+0000","last_became_peered":"2024-09-13T11:12:05.710876+0000","last_unstale":"2024-09-13T11:15:13.777443+0000","last_undegraded":"2024-09-13T11:15:13.777443+0000","last_fullsized":"2024-09-13T11:15:13.777443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4653,"log_dups_size":0,"ondisk_log_size":4653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:43.433333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107063120,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":4630,"num_write_kb":171206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.172123+0000","last_change":"2024-09-13T11:11:59.264364+0000","last_active":"2024-09-13T11:16:29.172123+0000","last_peered":"2024-09-13T11:16:29.172123+0000","last_clean":"2024-09-13T11:16:29.172123+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:16:29.172123+0000","last_undegraded":"2024-09-13T11:16:29.172123+0000","last_fullsized":"2024-09-13T11:16:29.172123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:46.598343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8136","reported_seq":8158,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:31.838203+0000","last_change":"2024-09-13T11:12:05.889138+0000","last_active":"2024-09-13T11:15:31.838203+0000","last_peered":"2024-09-13T11:15:31.838203+0000","last_clean":"2024-09-13T11:15:31.838203+0000","last_became_active":"2024-09-13T11:12:05.888409+0000","last_became_peered":"2024-09-13T11:12:05.888409+0000","last_unstale":"2024-09-13T11:15:31.838203+0000","last_undegraded":"2024-09-13T11:15:31.838203+0000","last_fullsized":"2024-09-13T11:15:31.838203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8136,"log_dups_size":0,"ondisk_log_size":8136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:16.890148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543104,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":8142,"num_write_kb":253572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.323610+0000","last_change":"2024-09-13T11:11:59.171084+0000","last_active":"2024-09-13T11:15:13.323610+0000","last_peered":"2024-09-13T11:15:13.323610+0000","last_clean":"2024-09-13T11:15:13.323610+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:15:13.323610+0000","last_undegraded":"2024-09-13T11:15:13.323610+0000","last_fullsized":"2024-09-13T11:15:13.323610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:01.700221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'4755","reported_seq":4774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197667+0000","last_change":"2024-09-13T11:12:05.729028+0000","last_active":"2024-09-13T11:16:29.197667+0000","last_peered":"2024-09-13T11:16:29.197667+0000","last_clean":"2024-09-13T11:16:29.197667+0000","last_became_active":"2024-09-13T11:12:05.726919+0000","last_became_peered":"2024-09-13T11:12:05.726919+0000","last_unstale":"2024-09-13T11:16:29.197667+0000","last_undegraded":"2024-09-13T11:16:29.197667+0000","last_fullsized":"2024-09-13T11:16:29.197667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:42.310569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4753,"num_write_kb":177157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'6488","reported_seq":6831,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151891+0000","last_change":"2024-09-13T11:12:05.724178+0000","last_active":"2024-09-13T11:16:29.151891+0000","last_peered":"2024-09-13T11:16:29.151891+0000","last_clean":"2024-09-13T11:16:29.151891+0000","last_became_active":"2024-09-13T11:12:05.715353+0000","last_became_peered":"2024-09-13T11:12:05.715353+0000","last_unstale":"2024-09-13T11:16:29.151891+0000","last_undegraded":"2024-09-13T11:16:29.151891+0000","last_fullsized":"2024-09-13T11:16:29.151891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6488,"log_dups_size":0,"ondisk_log_size":6488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:39:43.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1078,"num_read_kb":960,"num_write":6740,"num_write_kb":218838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196274+0000","last_change":"2024-09-13T11:11:59.177551+0000","last_active":"2024-09-13T11:16:29.196274+0000","last_peered":"2024-09-13T11:16:29.196274+0000","last_clean":"2024-09-13T11:16:29.196274+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:16:29.196274+0000","last_undegraded":"2024-09-13T11:16:29.196274+0000","last_fullsized":"2024-09-13T11:16:29.196274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:06.698959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"24'3583","reported_seq":3600,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.768120+0000","last_change":"2024-09-13T11:12:05.890104+0000","last_active":"2024-09-13T11:15:13.768120+0000","last_peered":"2024-09-13T11:15:13.768120+0000","last_clean":"2024-09-13T11:15:13.768120+0000","last_became_active":"2024-09-13T11:12:05.889331+0000","last_became_peered":"2024-09-13T11:12:05.889331+0000","last_unstale":"2024-09-13T11:15:13.768120+0000","last_undegraded":"2024-09-13T11:15:13.768120+0000","last_fullsized":"2024-09-13T11:15:13.768120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3583,"log_dups_size":0,"ondisk_log_size":3583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:36.750096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3535,"num_write_kb":168833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.318703+0000","last_change":"2024-09-13T11:11:59.262864+0000","last_active":"2024-09-13T11:15:13.318703+0000","last_peered":"2024-09-13T11:15:13.318703+0000","last_clean":"2024-09-13T11:15:13.318703+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:15:13.318703+0000","last_undegraded":"2024-09-13T11:15:13.318703+0000","last_fullsized":"2024-09-13T11:15:13.318703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:49.061602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"24'3817","reported_seq":3834,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.771059+0000","last_change":"2024-09-13T11:12:05.716843+0000","last_active":"2024-09-13T11:15:13.771059+0000","last_peered":"2024-09-13T11:15:13.771059+0000","last_clean":"2024-09-13T11:15:13.771059+0000","last_became_active":"2024-09-13T11:12:05.716555+0000","last_became_peered":"2024-09-13T11:12:05.716555+0000","last_unstale":"2024-09-13T11:15:13.771059+0000","last_undegraded":"2024-09-13T11:15:13.771059+0000","last_fullsized":"2024-09-13T11:15:13.771059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3817,"log_dups_size":0,"ondisk_log_size":3817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:33.343050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":161030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171199+0000","last_change":"2024-09-13T11:11:59.264363+0000","last_active":"2024-09-13T11:16:29.171199+0000","last_peered":"2024-09-13T11:16:29.171199+0000","last_clean":"2024-09-13T11:16:29.171199+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:16:29.171199+0000","last_undegraded":"2024-09-13T11:16:29.171199+0000","last_fullsized":"2024-09-13T11:16:29.171199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:02.989025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'5147","reported_seq":5183,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:26.496646+0000","last_change":"2024-09-13T11:12:05.717945+0000","last_active":"2024-09-13T11:15:26.496646+0000","last_peered":"2024-09-13T11:15:26.496646+0000","last_clean":"2024-09-13T11:15:26.496646+0000","last_became_active":"2024-09-13T11:12:05.717715+0000","last_became_peered":"2024-09-13T11:12:05.717715+0000","last_unstale":"2024-09-13T11:15:26.496646+0000","last_undegraded":"2024-09-13T11:15:26.496646+0000","last_fullsized":"2024-09-13T11:15:26.496646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5147,"log_dups_size":0,"ondisk_log_size":5147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:00:42.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":5176,"num_write_kb":147263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196089+0000","last_change":"2024-09-13T11:11:59.175526+0000","last_active":"2024-09-13T11:16:29.196089+0000","last_peered":"2024-09-13T11:16:29.196089+0000","last_clean":"2024-09-13T11:16:29.196089+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:16:29.196089+0000","last_undegraded":"2024-09-13T11:16:29.196089+0000","last_fullsized":"2024-09-13T11:16:29.196089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:13.643417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171211+0000","last_change":"2024-09-13T11:11:49.099967+0000","last_active":"2024-09-13T11:16:29.171211+0000","last_peered":"2024-09-13T11:16:29.171211+0000","last_clean":"2024-09-13T11:16:29.171211+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:16:29.171211+0000","last_undegraded":"2024-09-13T11:16:29.171211+0000","last_fullsized":"2024-09-13T11:16:29.171211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_clean_scrub_stamp":"2024-09-13T11:11:48.073845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:02.753349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"24'2972","reported_seq":2998,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.772941+0000","last_change":"2024-09-13T11:12:05.700433+0000","last_active":"2024-09-13T11:15:13.772941+0000","last_peered":"2024-09-13T11:15:13.772941+0000","last_clean":"2024-09-13T11:15:13.772941+0000","last_became_active":"2024-09-13T11:12:05.700153+0000","last_became_peered":"2024-09-13T11:12:05.700153+0000","last_unstale":"2024-09-13T11:15:13.772941+0000","last_undegraded":"2024-09-13T11:15:13.772941+0000","last_fullsized":"2024-09-13T11:15:13.772941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2972,"log_dups_size":0,"ondisk_log_size":2972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:13.356022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104988672,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":2914,"num_write_kb":144131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'8252","reported_seq":8395,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.241374+0000","last_change":"2024-09-13T11:12:05.888680+0000","last_active":"2024-09-13T11:16:29.241374+0000","last_peered":"2024-09-13T11:16:29.241374+0000","last_clean":"2024-09-13T11:16:29.241374+0000","last_became_active":"2024-09-13T11:12:05.888170+0000","last_became_peered":"2024-09-13T11:12:05.888170+0000","last_unstale":"2024-09-13T11:16:29.241374+0000","last_undegraded":"2024-09-13T11:16:29.241374+0000","last_fullsized":"2024-09-13T11:16:29.241374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8252,"log_dups_size":0,"ondisk_log_size":8252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:46:22.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114688000,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":430,"num_read_kb":380,"num_write":6298,"num_write_kb":189330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"24'5168","reported_seq":5188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:31.760296+0000","last_change":"2024-09-13T11:12:05.727588+0000","last_active":"2024-09-13T11:15:31.760296+0000","last_peered":"2024-09-13T11:15:31.760296+0000","last_clean":"2024-09-13T11:15:31.760296+0000","last_became_active":"2024-09-13T11:12:05.726759+0000","last_became_peered":"2024-09-13T11:12:05.726759+0000","last_unstale":"2024-09-13T11:15:31.760296+0000","last_undegraded":"2024-09-13T11:15:31.760296+0000","last_fullsized":"2024-09-13T11:15:31.760296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5168,"log_dups_size":0,"ondisk_log_size":5168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:38.027194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":5148,"num_write_kb":185606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'4264","reported_seq":4292,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.387902+0000","last_change":"2024-09-13T11:12:05.709828+0000","last_active":"2024-09-13T11:15:13.387902+0000","last_peered":"2024-09-13T11:15:13.387902+0000","last_clean":"2024-09-13T11:15:13.387902+0000","last_became_active":"2024-09-13T11:12:05.709368+0000","last_became_peered":"2024-09-13T11:12:05.709368+0000","last_unstale":"2024-09-13T11:15:13.387902+0000","last_undegraded":"2024-09-13T11:15:13.387902+0000","last_fullsized":"2024-09-13T11:15:13.387902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":0,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.129402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121635328,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":4285,"num_write_kb":189832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'4764","reported_seq":4788,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196993+0000","last_change":"2024-09-13T11:12:05.719371+0000","last_active":"2024-09-13T11:16:29.196993+0000","last_peered":"2024-09-13T11:16:29.196993+0000","last_clean":"2024-09-13T11:16:29.196993+0000","last_became_active":"2024-09-13T11:12:05.716884+0000","last_became_peered":"2024-09-13T11:12:05.716884+0000","last_unstale":"2024-09-13T11:16:29.196993+0000","last_undegraded":"2024-09-13T11:16:29.196993+0000","last_fullsized":"2024-09-13T11:16:29.196993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:34.250313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130220552,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":27,"num_read_kb":83,"num_write":4732,"num_write_kb":234695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3101","reported_seq":3135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171732+0000","last_change":"2024-09-13T11:12:05.731406+0000","last_active":"2024-09-13T11:16:29.171732+0000","last_peered":"2024-09-13T11:16:29.171732+0000","last_clean":"2024-09-13T11:16:29.171732+0000","last_became_active":"2024-09-13T11:12:05.730642+0000","last_became_peered":"2024-09-13T11:12:05.730642+0000","last_unstale":"2024-09-13T11:16:29.171732+0000","last_undegraded":"2024-09-13T11:16:29.171732+0000","last_fullsized":"2024-09-13T11:16:29.171732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3101,"log_dups_size":0,"ondisk_log_size":3101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:34.115785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98697744,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":61,"num_read_kb":48,"num_write":3111,"num_write_kb":136971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'4813","reported_seq":4935,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.214604+0000","last_change":"2024-09-13T11:12:05.731761+0000","last_active":"2024-09-13T11:16:29.214604+0000","last_peered":"2024-09-13T11:16:29.214604+0000","last_clean":"2024-09-13T11:16:29.214604+0000","last_became_active":"2024-09-13T11:12:05.731054+0000","last_became_peered":"2024-09-13T11:12:05.731054+0000","last_unstale":"2024-09-13T11:16:29.214604+0000","last_undegraded":"2024-09-13T11:16:29.214604+0000","last_fullsized":"2024-09-13T11:16:29.214604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4813,"log_dups_size":0,"ondisk_log_size":4813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:45.840805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120398352,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":345,"num_read_kb":457,"num_write":5199,"num_write_kb":163956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'5304","reported_seq":5322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.246195+0000","last_change":"2024-09-13T11:12:05.723811+0000","last_active":"2024-09-13T11:16:29.246195+0000","last_peered":"2024-09-13T11:16:29.246195+0000","last_clean":"2024-09-13T11:16:29.246195+0000","last_became_active":"2024-09-13T11:12:05.722874+0000","last_became_peered":"2024-09-13T11:12:05.722874+0000","last_unstale":"2024-09-13T11:16:29.246195+0000","last_undegraded":"2024-09-13T11:16:29.246195+0000","last_fullsized":"2024-09-13T11:16:29.246195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5304,"log_dups_size":0,"ondisk_log_size":5304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.959449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148860928,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":228833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"24'2493","reported_seq":2511,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.763829+0000","last_change":"2024-09-13T11:12:05.713322+0000","last_active":"2024-09-13T11:15:13.763829+0000","last_peered":"2024-09-13T11:15:13.763829+0000","last_clean":"2024-09-13T11:15:13.763829+0000","last_became_active":"2024-09-13T11:12:05.712482+0000","last_became_peered":"2024-09-13T11:12:05.712482+0000","last_unstale":"2024-09-13T11:15:13.763829+0000","last_undegraded":"2024-09-13T11:15:13.763829+0000","last_fullsized":"2024-09-13T11:15:13.763829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2493,"log_dups_size":0,"ondisk_log_size":2493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:50.799467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497984,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2455,"num_write_kb":115332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4070","reported_seq":4090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171469+0000","last_change":"2024-09-13T11:12:05.729681+0000","last_active":"2024-09-13T11:16:29.171469+0000","last_peered":"2024-09-13T11:16:29.171469+0000","last_clean":"2024-09-13T11:16:29.171469+0000","last_became_active":"2024-09-13T11:12:05.728964+0000","last_became_peered":"2024-09-13T11:12:05.728964+0000","last_unstale":"2024-09-13T11:16:29.171469+0000","last_undegraded":"2024-09-13T11:16:29.171469+0000","last_fullsized":"2024-09-13T11:16:29.171469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:54.843915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99232096,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":4074,"num_write_kb":180077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"24'3595","reported_seq":3616,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T11:15:13.764513+0000","last_change":"2024-09-13T11:12:05.720869+0000","last_active":"2024-09-13T11:15:13.764513+0000","last_peered":"2024-09-13T11:15:13.764513+0000","last_clean":"2024-09-13T11:15:13.764513+0000","last_became_active":"2024-09-13T11:12:05.720600+0000","last_became_peered":"2024-09-13T11:12:05.720600+0000","last_unstale":"2024-09-13T11:15:13.764513+0000","last_undegraded":"2024-09-13T11:15:13.764513+0000","last_fullsized":"2024-09-13T11:15:13.764513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3595,"log_dups_size":0,"ondisk_log_size":3595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:58:51.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":152845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'9050","reported_seq":9082,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171396+0000","last_change":"2024-09-13T11:12:05.731290+0000","last_active":"2024-09-13T11:16:29.171396+0000","last_peered":"2024-09-13T11:16:29.171396+0000","last_clean":"2024-09-13T11:16:29.171396+0000","last_became_active":"2024-09-13T11:12:05.729859+0000","last_became_peered":"2024-09-13T11:12:05.729859+0000","last_unstale":"2024-09-13T11:16:29.171396+0000","last_undegraded":"2024-09-13T11:16:29.171396+0000","last_fullsized":"2024-09-13T11:16:29.171396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9050,"log_dups_size":0,"ondisk_log_size":9050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:53:12.549090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":9057,"num_write_kb":215054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3578757896,"num_objects":881,"num_object_clones":0,"num_object_copies":1762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":881,"num_whiteouts":0,"num_read":2554,"num_read_kb":2565,"num_write":162763,"num_write_kb":5648753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7157350400,"data_stored":7157253648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164516,"ondisk_log_size":164516,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286328,"kb_used_data":1102504,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93085512,"statfs":{"total":96636764160,"available":95319564288,"internally_reserved":0,"allocated":1128964096,"data_stored":1128781606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":188217803},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077852,"kb_used_data":916236,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":93293988,"statfs":{"total":96636764160,"available":95533043712,"internally_reserved":0,"allocated":938225664,"data_stored":938048425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1685516,"kb_used_data":1437884,"kb_used_omap":1,"kb_used_meta":247614,"kb_avail":92686324,"statfs":{"total":96636764160,"available":94910795776,"internally_reserved":0,"allocated":1472393216,"data_stored":1472211750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253557189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542204,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429572,"kb_used_data":349876,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":93942268,"statfs":{"total":96636764160,"available":96196882432,"internally_reserved":0,"allocated":358273024,"data_stored":358115198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542204,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765328,"kb_used_data":635648,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":93606512,"statfs":{"total":96636764160,"available":95853068288,"internally_reserved":0,"allocated":650903552,"data_stored":650734513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361036,"kb_used_data":303484,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94010804,"statfs":{"total":96636764160,"available":96267063296,"internally_reserved":0,"allocated":310767616,"data_stored":310602622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1312892,"kb_used_data":1137388,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":93058948,"statfs":{"total":96636764160,"available":95292362752,"internally_reserved":0,"allocated":1164685312,"data_stored":1164514518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179698119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1289364,"kb_used_data":1109700,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":93082476,"statfs":{"total":96636764160,"available":95316455424,"internally_reserved":0,"allocated":1136332800,"data_stored":1136162030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1135489024,"data_stored":1135479632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":650649600,"data_stored":650642464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":358023168,"data_stored":358023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1164435456,"data_stored":1164422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1472143360,"data_stored":1472119720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":937971712,"data_stored":937956376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":310517760,"data_stored":310510592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1128120320,"data_stored":1128099208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:16:30.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T11:16:30.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 Processor -- start 2024-09-13T11:16:30.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 -- start start 2024-09-13T11:16:30.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f541813a310 0x7f54180b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f541813a6f0 0x7f5418147160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54180b10b0 con 0x7f54180b1c70 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f54180b0920 con 0x7f541813a310 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f541d287640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5418147db0 con 0x7f541813a6f0 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f541813a310 0x7f54180b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f541813a310 0x7f54180b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35864/0 (socket says 172.21.15.39:35864) 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 -- 172.21.15.39:0/1301270163 learned_addr learned my addr 172.21.15.39:0/1301270163 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f54167fc640 1 --2- 172.21.15.39:0/1301270163 >> v2:172.21.15.102:3300/0 conn(0x7f541813a6f0 0x7f5418147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 -- 172.21.15.39:0/1301270163 >> v2:172.21.15.102:3300/0 conn(0x7f541813a6f0 msgr2=0x7f5418147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 --2- 172.21.15.39:0/1301270163 >> v2:172.21.15.102:3300/0 conn(0x7f541813a6f0 0x7f5418147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 -- 172.21.15.39:0/1301270163 >> v1:172.21.15.102:6789/0 conn(0x7f54180b1c70 legacy=0x7f54181476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:30.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.933+0000 7f5416ffd640 1 -- 172.21.15.39:0/1301270163 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54180b2cb0 con 0x7f541813a310 2024-09-13T11:16:30.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f5416ffd640 1 --2- 172.21.15.39:0/1301270163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541813a310 0x7f54180b2770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54180b31e0 tx=0x7f540801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff819c562e7b4cba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f5415ffb640 1 -- 172.21.15.39:0/1301270163 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080b0070 con 0x7f541813a310 2024-09-13T11:16:30.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f5415ffb640 1 -- 172.21.15.39:0/1301270163 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54080ab600 con 0x7f541813a310 2024-09-13T11:16:30.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f5415ffb640 1 -- 172.21.15.39:0/1301270163 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54080ab9d0 con 0x7f541813a310 2024-09-13T11:16:30.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- 172.21.15.39:0/1301270163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541813a310 msgr2=0x7f54180b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 --2- 172.21.15.39:0/1301270163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541813a310 0x7f54180b2770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f54180b31e0 tx=0x7f540801c470 comp rx=0 tx=0).stop 2024-09-13T11:16:30.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- 172.21.15.39:0/1301270163 shutdown_connections 2024-09-13T11:16:30.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 --2- 172.21.15.39:0/1301270163 >> v2:172.21.15.102:3300/0 conn(0x7f541813a6f0 0x7f5418147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 --2- 172.21.15.39:0/1301270163 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541813a310 0x7f54180b2770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- 172.21.15.39:0/1301270163 >> 172.21.15.39:0/1301270163 conn(0x7f54180b5dd0 msgr2=0x7f54180b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:30.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- 172.21.15.39:0/1301270163 shutdown_connections 2024-09-13T11:16:30.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- 172.21.15.39:0/1301270163 wait complete. 2024-09-13T11:16:30.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 Processor -- start 2024-09-13T11:16:30.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- start start 2024-09-13T11:16:30.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541813a310 0x7f5418073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541814c7d0 0x7f54181366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5418136bf0 0x7f54181df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5418150ef0 con 0x7f541814c7d0 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5418150d70 con 0x7f541813a310 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f541d287640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f5418151070 con 0x7f5418136bf0 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f54167fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541814c7d0 0x7f54181366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f54177fe640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5418136bf0 0x7f54181df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f54167fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541814c7d0 0x7f54181366b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35868/0 (socket says 172.21.15.39:35868) 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.937+0000 7f54167fc640 1 -- 172.21.15.39:0/2572521989 learned_addr learned my addr 172.21.15.39:0/2572521989 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f5416ffd640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541813a310 0x7f5418073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f54177fe640 1 -- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541813a310 msgr2=0x7f5418073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f54177fe640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541813a310 0x7f5418073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f54177fe640 1 -- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541814c7d0 msgr2=0x7f54181366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f54177fe640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541814c7d0 0x7f54181366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f54177fe640 1 -- 172.21.15.39:0/2572521989 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541814d080 con 0x7f5418136bf0 2024-09-13T11:16:30.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f54177fe640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5418136bf0 0x7f54181df6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f541000bdd0 tx=0x7f5410009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410019070 con 0x7f5418136bf0 2024-09-13T11:16:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541000cdf0 con 0x7f5418136bf0 2024-09-13T11:16:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410014680 con 0x7f5418136bf0 2024-09-13T11:16:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54181370d0 con 0x7f5418136bf0 2024-09-13T11:16:30.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5418139ec0 con 0x7f5418136bf0 2024-09-13T11:16:30.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54180b2770 con 0x7f5418136bf0 2024-09-13T11:16:30.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f541001c070 con 0x7f5418136bf0 2024-09-13T11:16:30.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f53ff7fe640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5404072100 0x7f54040745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:30.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f5410092740 con 0x7f5418136bf0 2024-09-13T11:16:30.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f5416ffd640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5404072100 0x7f54040745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:30.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.941+0000 7f5416ffd640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5404072100 0x7f54040745c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5418143af0 tx=0x7f5408008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:30.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:30.945+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f541005da90 con 0x7f5418136bf0 2024-09-13T11:16:31.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.117+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f541814ce60 con 0x7f5418136bf0 2024-09-13T11:16:31.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.117+0000 7f53ff7fe640 1 -- 172.21.15.39:0/2572521989 <== mon.2 v2:172.21.15.39:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16691 (secure 0 0 0) 0x7f5410062250 con 0x7f5418136bf0 2024-09-13T11:16:31.122 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:16:31.122 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":25,"fsid":"14a7ff11-8012-4cb4-a474-c65ae9644761","created":"2024-09-13T11:11:36.977270+0000","modified":"2024-09-13T11:16:29.141181+0000","last_up_change":"2024-09-13T11:11:48.073845+0000","last_in_change":"2024-09-13T11:11:39.360650+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T11:11:48.029865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T11:11:55.369110+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephsqlite","create_time":"2024-09-13T11:12:04.445149+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a629f7f1-92ab-4d94-ba61-c62fa852306e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6809","nonce":1555151115}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6811","nonce":1555151115}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6815","nonce":1555151115}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":1555151115},{"type":"v1","addr":"172.21.15.39:6813","nonce":1555151115}]},"public_addr":"172.21.15.39:6809/1555151115","cluster_addr":"172.21.15.39:6811/1555151115","heartbeat_back_addr":"172.21.15.39:6815/1555151115","heartbeat_front_addr":"172.21.15.39:6813/1555151115","state":["exists","up"]},{"osd":1,"uuid":"9d8513e1-06f1-467f-b43c-cfa2c3ba2b2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6817","nonce":3509723286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6819","nonce":3509723286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6823","nonce":3509723286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":3509723286},{"type":"v1","addr":"172.21.15.39:6821","nonce":3509723286}]},"public_addr":"172.21.15.39:6817/3509723286","cluster_addr":"172.21.15.39:6819/3509723286","heartbeat_back_addr":"172.21.15.39:6823/3509723286","heartbeat_front_addr":"172.21.15.39:6821/3509723286","state":["exists","up"]},{"osd":2,"uuid":"4f366e2c-b85b-48a5-80a9-a705cf7eac3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6825","nonce":1540683038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6827","nonce":1540683038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6831","nonce":1540683038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1540683038},{"type":"v1","addr":"172.21.15.39:6829","nonce":1540683038}]},"public_addr":"172.21.15.39:6825/1540683038","cluster_addr":"172.21.15.39:6827/1540683038","heartbeat_back_addr":"172.21.15.39:6831/1540683038","heartbeat_front_addr":"172.21.15.39:6829/1540683038","state":["exists","up"]},{"osd":3,"uuid":"b9bae4c0-1450-4201-a1c5-72e3ed8ab82e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6801","nonce":2999541781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6803","nonce":2999541781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6807","nonce":2999541781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":2999541781},{"type":"v1","addr":"172.21.15.39:6805","nonce":2999541781}]},"public_addr":"172.21.15.39:6801/2999541781","cluster_addr":"172.21.15.39:6803/2999541781","heartbeat_back_addr":"172.21.15.39:6807/2999541781","heartbeat_front_addr":"172.21.15.39:6805/2999541781","state":["exists","up"]},{"osd":4,"uuid":"9d122931-52a3-4486-973e-c979703307da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6817","nonce":3161248300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6819","nonce":3161248300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6823","nonce":3161248300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3161248300},{"type":"v1","addr":"172.21.15.102:6821","nonce":3161248300}]},"public_addr":"172.21.15.102:6817/3161248300","cluster_addr":"172.21.15.102:6819/3161248300","heartbeat_back_addr":"172.21.15.102:6823/3161248300","heartbeat_front_addr":"172.21.15.102:6821/3161248300","state":["exists","up"]},{"osd":5,"uuid":"10e2e7b3-f8c5-4ef3-ad4f-e07da0bddd23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6825","nonce":498174754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6827","nonce":498174754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6831","nonce":498174754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":498174754},{"type":"v1","addr":"172.21.15.102:6829","nonce":498174754}]},"public_addr":"172.21.15.102:6825/498174754","cluster_addr":"172.21.15.102:6827/498174754","heartbeat_back_addr":"172.21.15.102:6831/498174754","heartbeat_front_addr":"172.21.15.102:6829/498174754","state":["exists","up"]},{"osd":6,"uuid":"281e59b9-335b-488f-842c-8730faf46fd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6809","nonce":2547475669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6811","nonce":2547475669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6815","nonce":2547475669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":2547475669},{"type":"v1","addr":"172.21.15.102:6813","nonce":2547475669}]},"public_addr":"172.21.15.102:6809/2547475669","cluster_addr":"172.21.15.102:6811/2547475669","heartbeat_back_addr":"172.21.15.102:6815/2547475669","heartbeat_front_addr":"172.21.15.102:6813/2547475669","state":["exists","up"]},{"osd":7,"uuid":"47e46895-c208-4a00-9c67-fb8285be4d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6801","nonce":3217028379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6803","nonce":3217028379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6807","nonce":3217028379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3217028379},{"type":"v1","addr":"172.21.15.102:6805","nonce":3217028379}]},"public_addr":"172.21.15.102:6801/3217028379","cluster_addr":"172.21.15.102:6803/3217028379","heartbeat_back_addr":"172.21.15.102:6807/3217028379","heartbeat_front_addr":"172.21.15.102:6805/3217028379","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.901346+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.448139+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441429+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.486773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.441490+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.499628+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:45.879979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T11:11:46.320145+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:0/753178573":"2024-09-13T12:16:28.606095+0000","172.21.15.39:0/1443112071":"2024-09-13T12:15:13.246964+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5404072100 msgr2=0x7f54040745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5404072100 0x7f54040745c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5418143af0 tx=0x7f5408008040 comp rx=0 tx=0).stop 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5418136bf0 msgr2=0x7f54181df6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5418136bf0 0x7f54181df6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f541000bdd0 tx=0x7f5410009ed0 comp rx=0 tx=0).stop 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 shutdown_connections 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f5404072100 0x7f54040745c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f5418136bf0 0x7f54181df6b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f541814c7d0 0x7f54181366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 --2- 172.21.15.39:0/2572521989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f541813a310 0x7f5418073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:31.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 >> 172.21.15.39:0/2572521989 conn(0x7f54180b5dd0 msgr2=0x7f54180b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:31.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 shutdown_connections 2024-09-13T11:16:31.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:31.121+0000 7f541d287640 1 -- 172.21.15.39:0/2572521989 wait complete. 2024-09-13T11:16:32.144 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T11:16:32.144 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 Processor -- start 2024-09-13T11:16:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 -- start start 2024-09-13T11:16:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 0x7f551c144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 0x7f551c145240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f551c073c50 con 0x7f551c0ab080 2024-09-13T11:16:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f551c0ac710 con 0x7f551c0aa6d0 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5520908640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f551c0aab60 con 0x7f551c073870 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 0x7f551c144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5519d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 0x7f551c145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 0x7f551c144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57260/0 (socket says 172.21.15.39:57260) 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 -- 172.21.15.39:0/1693335187 learned_addr learned my addr 172.21.15.39:0/1693335187 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5519d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 0x7f551c145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35876/0 (socket says 172.21.15.39:35876) 2024-09-13T11:16:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 -- 172.21.15.39:0/1693335187 >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 msgr2=0x7f551c145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 --2- 172.21.15.39:0/1693335187 >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 0x7f551c145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 -- 172.21.15.39:0/1693335187 >> v1:172.21.15.102:6789/0 conn(0x7f551c0ab080 legacy=0x7f551c13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f551a59c640 1 -- 172.21.15.39:0/1693335187 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c142820 con 0x7f551c073870 2024-09-13T11:16:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.281+0000 7f5519d9b640 1 --2- 172.21.15.39:0/1693335187 >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 0x7f551c145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f551a59c640 1 --2- 172.21.15.39:0/1693335187 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 0x7f551c144d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f550c0098a0 tx=0x7f550c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2f4243f293be5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f551959a640 1 -- 172.21.15.39:0/1693335187 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c0b0070 con 0x7f551c073870 2024-09-13T11:16:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f551959a640 1 -- 172.21.15.39:0/1693335187 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550c0ab600 con 0x7f551c073870 2024-09-13T11:16:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f551959a640 1 -- 172.21.15.39:0/1693335187 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550c0ab9d0 con 0x7f551c073870 2024-09-13T11:16:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 -- 172.21.15.39:0/1693335187 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 msgr2=0x7f551c144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 --2- 172.21.15.39:0/1693335187 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 0x7f551c144d00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f550c0098a0 tx=0x7f550c01c400 comp rx=0 tx=0).stop 2024-09-13T11:16:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 -- 172.21.15.39:0/1693335187 shutdown_connections 2024-09-13T11:16:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 --2- 172.21.15.39:0/1693335187 >> v2:172.21.15.39:3300/0 conn(0x7f551c0aa6d0 0x7f551c145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 --2- 172.21.15.39:0/1693335187 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c073870 0x7f551c144d00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 -- 172.21.15.39:0/1693335187 >> 172.21.15.39:0/1693335187 conn(0x7f551c06d460 msgr2=0x7f551c0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 -- 172.21.15.39:0/1693335187 shutdown_connections 2024-09-13T11:16:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.285+0000 7f5520908640 1 -- 172.21.15.39:0/1693335187 wait complete. 2024-09-13T11:16:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 Processor -- start 2024-09-13T11:16:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- start start 2024-09-13T11:16:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f551c073870 0x7f551c1df5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f551c0ab080 0x7f551c140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c13fbe0 0x7f551c138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f551c14ec40 con 0x7f551c0ab080 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f551c14eac0 con 0x7f551c073870 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f551c14edc0 con 0x7f551c13fbe0 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c13fbe0 0x7f551c138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5519d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f551c0ab080 0x7f551c140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c13fbe0 0x7f551c138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57262/0 (socket says 172.21.15.39:57262) 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5519d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f551c0ab080 0x7f551c140910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35886/0 (socket says 172.21.15.39:35886) 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 -- 172.21.15.39:0/3576822529 learned_addr learned my addr 172.21.15.39:0/3576822529 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551a59c640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f551c073870 0x7f551c1df5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 -- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f551c073870 msgr2=0x7f551c1df5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f551c073870 0x7f551c1df5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 -- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f551c0ab080 msgr2=0x7f551c140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f551c0ab080 0x7f551c140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 -- 172.21.15.39:0/3576822529 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c1dd1c0 con 0x7f551c13fbe0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5519d9b640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f551c0ab080 0x7f551c140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f551ad9d640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c13fbe0 0x7f551c138b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f551400c790 tx=0x7f551400cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514003b80 con 0x7f551c13fbe0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5514003d20 con 0x7f551c13fbe0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f551c1dfb30 con 0x7f551c13fbe0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551400aa70 con 0x7f551c13fbe0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f551c140e50 con 0x7f551c13fbe0 2024-09-13T11:16:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f551c13e650 con 0x7f551c13fbe0 2024-09-13T11:16:32.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f551400ac10 con 0x7f551c13fbe0 2024-09-13T11:16:32.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f550affd640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f54fc072100 0x7f54fc0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.289+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f55140930f0 con 0x7f551c13fbe0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f550affd640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f54fc0792c0 0x7f54fc07b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 --> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5514004ec0 con 0x7f54fc0792c0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5514093580 con 0x7f551c13fbe0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f5519d9b640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f54fc0792c0 0x7f54fc07b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f551a59c640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f54fc072100 0x7f54fc0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f5519d9b640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f54fc0792c0 0x7f54fc07b6e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f551a59c640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f54fc072100 0x7f54fc0745c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f550c0ad000 tx=0x7f550c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.293+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== osd.0 v2:172.21.15.39:6808/1555151115 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5514004ec0 con 0x7f54fc0792c0 2024-09-13T11:16:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 --> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f551c070e20 con 0x7f54fc0792c0 2024-09-13T11:16:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f550affd640 1 -- 172.21.15.39:0/3576822529 <== osd.0 v2:172.21.15.39:6808/1555151115 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f551c070e20 con 0x7f54fc0792c0 2024-09-13T11:16:32.311 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:32.311 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:32.311 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f54fc0792c0 msgr2=0x7f54fc07b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:6808/1555151115,v1:172.21.15.39:6809/1555151115] conn(0x7f54fc0792c0 0x7f54fc07b6e0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f54fc072100 msgr2=0x7f54fc0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f54fc072100 0x7f54fc0745c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f550c0ad000 tx=0x7f550c008040 comp rx=0 tx=0).stop 2024-09-13T11:16:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c13fbe0 msgr2=0x7f551c138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 --2- 172.21.15.39:0/3576822529 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f551c13fbe0 0x7f551c138b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f551400c790 tx=0x7f551400cc50 comp rx=0 tx=0).stop 2024-09-13T11:16:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f551ad9d640 1 -- 172.21.15.39:0/3576822529 reap_dead start 2024-09-13T11:16:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 shutdown_connections 2024-09-13T11:16:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 >> 172.21.15.39:0/3576822529 conn(0x7f551c06d460 msgr2=0x7f551c070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 shutdown_connections 2024-09-13T11:16:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.305+0000 7f5520908640 1 -- 172.21.15.39:0/3576822529 wait complete. 2024-09-13T11:16:32.328 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T11:16:32.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbf0b9640 1 Processor -- start 2024-09-13T11:16:32.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbf0b9640 1 -- start start 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbf0b9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bb806fc80 0x7f4bb8070060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbf0b9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb8143c00 con 0x7f4bb8142dc0 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbf0b9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bb8143920 con 0x7f4bb81440b0 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbf0b9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb80708c0 con 0x7f4bb806fc80 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbce55640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4bb806fc80 0x7f4bb8070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bb7fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4bb8142dc0 0x7f4bb8143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50114/0 (socket says 172.21.15.39:50114) 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bb7fff640 1 -- 172.21.15.39:0/2367902395 learned_addr learned my addr 172.21.15.39:0/2367902395 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbce55640 1 -- 172.21.15.39:0/2367902395 >> v1:172.21.15.102:6789/0 conn(0x7f4bb81440b0 legacy=0x7f4bb81444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbce55640 1 -- 172.21.15.39:0/2367902395 >> v1:172.21.15.39:6789/0 conn(0x7f4bb8142dc0 legacy=0x7f4bb8143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.441+0000 7f4bbce55640 1 -- 172.21.15.39:0/2367902395 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8071760 con 0x7f4bb806fc80 2024-09-13T11:16:32.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbce55640 1 --2- 172.21.15.39:0/2367902395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb806fc80 0x7f4bb8070060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0097c0 tx=0x7f4bac01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f04b1f03e9fedf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bb77fe640 1 -- 172.21.15.39:0/2367902395 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0b1070 con 0x7f4bb806fc80 2024-09-13T11:16:32.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bb77fe640 1 -- 172.21.15.39:0/2367902395 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bac0a8050 con 0x7f4bb806fc80 2024-09-13T11:16:32.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bb77fe640 1 -- 172.21.15.39:0/2367902395 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac0ac860 con 0x7f4bb806fc80 2024-09-13T11:16:32.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/2367902395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb806fc80 msgr2=0x7f4bb8070060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/2367902395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb806fc80 0x7f4bb8070060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0097c0 tx=0x7f4bac01ce20 comp rx=0 tx=0).stop 2024-09-13T11:16:32.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/2367902395 shutdown_connections 2024-09-13T11:16:32.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/2367902395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb806fc80 0x7f4bb8070060 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/2367902395 >> 172.21.15.39:0/2367902395 conn(0x7f4bb80b9b80 msgr2=0x7f4bb80b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/2367902395 shutdown_connections 2024-09-13T11:16:32.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.445+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/2367902395 wait complete. 2024-09-13T11:16:32.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 Processor -- start 2024-09-13T11:16:32.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- start start 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 0x7f4bb8146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb8142dc0 0x7f4bb813a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb81440b0 0x7f4bb813a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb8151d40 con 0x7f4bb81440b0 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb8151bc0 con 0x7f4bb8142dc0 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb8151ec0 con 0x7f4bb806fc80 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbce55640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 0x7f4bb8146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb81440b0 0x7f4bb813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbce55640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 0x7f4bb8146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57266/0 (socket says 172.21.15.39:57266) 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbce55640 1 -- 172.21.15.39:0/3793070322 learned_addr learned my addr 172.21.15.39:0/3793070322 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bb7fff640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb8142dc0 0x7f4bb813a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 -- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 msgr2=0x7f4bb8146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 0x7f4bb8146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 -- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb8142dc0 msgr2=0x7f4bb813a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb8142dc0 0x7f4bb813a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 -- 172.21.15.39:0/3793070322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8147e10 con 0x7f4bb81440b0 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbce55640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 0x7f4bb8146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbd656640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb81440b0 0x7f4bb813a730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000be00 tx=0x7f4bb000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0003980 con 0x7f4bb81440b0 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bb0003b20 con 0x7f4bb81440b0 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb8145e50 con 0x7f4bb81440b0 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0004020 con 0x7f4bb81440b0 2024-09-13T11:16:32.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb813af10 con 0x7f4bb81440b0 2024-09-13T11:16:32.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.449+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb8141170 con 0x7f4bb81440b0 2024-09-13T11:16:32.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.453+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f4bb0006d10 con 0x7f4bb81440b0 2024-09-13T11:16:32.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.453+0000 7f4bb57fa640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.453+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f4bb00925b0 con 0x7f4bb81440b0 2024-09-13T11:16:32.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.453+0000 7f4bbce55640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.453+0000 7f4bbce55640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01aa70 tx=0x7f4bac004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.457+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4bb005d980 con 0x7f4bb81440b0 2024-09-13T11:16:32.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.629+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4bb8146080 con 0x7f4b9c072100 2024-09-13T11:16:32.636 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bb57fa640 1 -- 172.21.15.39:0/3793070322 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4bb8146080 con 0x7f4b9c072100 2024-09-13T11:16:32.636 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 msgr2=0x7f4b9c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4bac01aa70 tx=0x7f4bac004740 comp rx=0 tx=0).stop 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb81440b0 msgr2=0x7f4bb813a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb81440b0 0x7f4bb813a730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000be00 tx=0x7f4bb000bef0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 shutdown_connections 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f4b9c072100 0x7f4b9c0745c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bb81440b0 0x7f4bb813a730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bb8142dc0 0x7f4bb813a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 --2- 172.21.15.39:0/3793070322 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f4bb806fc80 0x7f4bb8146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 >> 172.21.15.39:0/3793070322 conn(0x7f4bb80b9b80 msgr2=0x7f4bb80b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 shutdown_connections 2024-09-13T11:16:32.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.633+0000 7f4bbf0b9640 1 -- 172.21.15.39:0/3793070322 wait complete. 2024-09-13T11:16:32.657 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T11:16:32.657 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:32.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f89016f2640 1 Processor -- start 2024-09-13T11:16:32.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f89016f2640 1 -- start start 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f89016f2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc073870 0x7f88fc144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f89016f2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88fc073c50 con 0x7f88fc0aa6d0 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f89016f2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88fc0ac760 con 0x7f88fc0ab080 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f89016f2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc0aac00 con 0x7f88fc073870 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f88faffd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc073870 0x7f88fc144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f88f27fc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f88fc0aa6d0 0x7f88fc13e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50122/0 (socket says 172.21.15.39:50122) 2024-09-13T11:16:32.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.777+0000 7f88f27fc640 1 -- 172.21.15.39:0/847720982 learned_addr learned my addr 172.21.15.39:0/847720982 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:32.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88fa7fc640 1 -- 172.21.15.39:0/847720982 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228468231 0 0) 0x7f88e4001120 con 0x7f88fc0aa6d0 2024-09-13T11:16:32.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88fa7fc640 1 -- 172.21.15.39:0/847720982 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88e8003530 con 0x7f88fc0aa6d0 2024-09-13T11:16:32.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88faffd640 1 -- 172.21.15.39:0/847720982 >> v1:172.21.15.102:6789/0 conn(0x7f88fc0ab080 legacy=0x7f88fc14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:32.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88faffd640 1 -- 172.21.15.39:0/847720982 >> v1:172.21.15.39:6789/0 conn(0x7f88fc0aa6d0 legacy=0x7f88fc13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88faffd640 1 -- 172.21.15.39:0/847720982 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc142870 con 0x7f88fc073870 2024-09-13T11:16:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88faffd640 1 --2- 172.21.15.39:0/847720982 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc073870 0x7f88fc144d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009820 tx=0x7f88ec01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dd164ea652ce42d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88fa7fc640 1 -- 172.21.15.39:0/847720982 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0b0070 con 0x7f88fc073870 2024-09-13T11:16:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88fa7fc640 1 -- 172.21.15.39:0/847720982 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ec0ab600 con 0x7f88fc073870 2024-09-13T11:16:32.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f88fa7fc640 1 -- 172.21.15.39:0/847720982 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0ab9d0 con 0x7f88fc073870 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 -- 172.21.15.39:0/847720982 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc073870 msgr2=0x7f88fc144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 --2- 172.21.15.39:0/847720982 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc073870 0x7f88fc144d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009820 tx=0x7f88ec01c380 comp rx=0 tx=0).stop 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 -- 172.21.15.39:0/847720982 shutdown_connections 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 --2- 172.21.15.39:0/847720982 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc073870 0x7f88fc144d00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 -- 172.21.15.39:0/847720982 >> 172.21.15.39:0/847720982 conn(0x7f88fc06d460 msgr2=0x7f88fc0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 -- 172.21.15.39:0/847720982 shutdown_connections 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.781+0000 7f89016f2640 1 -- 172.21.15.39:0/847720982 wait complete. 2024-09-13T11:16:32.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 Processor -- start 2024-09-13T11:16:32.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- start start 2024-09-13T11:16:32.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88fc073870 0x7f88fc140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc0ab080 0x7f88fc1394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88fc1dda50 0x7f88fc136990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc150500 con 0x7f88fc1dda50 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc150380 con 0x7f88fc073870 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f88fc150680 con 0x7f88fc0ab080 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc0ab080 0x7f88fc1394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88fc1dda50 0x7f88fc136990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88fb7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88fc1dda50 0x7f88fc136990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35916/0 (socket says 172.21.15.39:35916) 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88fb7fe640 1 -- 172.21.15.39:0/2533057353 learned_addr learned my addr 172.21.15.39:0/2533057353 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc0ab080 0x7f88fc1394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57280/0 (socket says 172.21.15.39:57280) 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88faffd640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88fc073870 0x7f88fc140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 -- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88fc073870 msgr2=0x7f88fc140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88fc073870 0x7f88fc140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 -- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88fc1dda50 msgr2=0x7f88fc136990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88fc1dda50 0x7f88fc136990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 -- 172.21.15.39:0/2533057353 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc13a7e0 con 0x7f88fc0ab080 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88fb7fe640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f88fc1dda50 0x7f88fc136990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f27fc640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc0ab080 0x7f88fc1394b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c730 tx=0x7f88e400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4017070 con 0x7f88fc0ab080 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e40058c0 con 0x7f88fc0ab080 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc0ace20 con 0x7f88fc0ab080 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4005c90 con 0x7f88fc0ab080 2024-09-13T11:16:32.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1385d0 con 0x7f88fc0ab080 2024-09-13T11:16:32.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.785+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88fc144d00 con 0x7f88fc0ab080 2024-09-13T11:16:32.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f88e401a070 con 0x7f88fc0ab080 2024-09-13T11:16:32.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f88dc072100 0x7f88dc0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f88e4092520 con 0x7f88fc0ab080 2024-09-13T11:16:32.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f88dc0792c0 0x7f88dc07b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 --> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88e401dec0 con 0x7f88dc0792c0 2024-09-13T11:16:32.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f88e40929b0 con 0x7f88fc0ab080 2024-09-13T11:16:32.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88faffd640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f88dc072100 0x7f88dc0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88fb7fe640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f88dc0792c0 0x7f88dc07b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88fb7fe640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f88dc0792c0 0x7f88dc07b6e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88faffd640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f88dc072100 0x7f88dc0745c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ad000 tx=0x7f88ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.789+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== osd.1 v2:172.21.15.39:6816/3509723286 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88e401dec0 con 0x7f88dc0792c0 2024-09-13T11:16:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 --> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f88fc1388c0 con 0x7f88dc0792c0 2024-09-13T11:16:32.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f88f3fff640 1 -- 172.21.15.39:0/2533057353 <== osd.1 v2:172.21.15.39:6816/3509723286 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f88fc1388c0 con 0x7f88dc0792c0 2024-09-13T11:16:32.809 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:32.809 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:32.809 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f88dc0792c0 msgr2=0x7f88dc07b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:6816/3509723286,v1:172.21.15.39:6817/3509723286] conn(0x7f88dc0792c0 0x7f88dc07b6e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f88dc072100 msgr2=0x7f88dc0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f88dc072100 0x7f88dc0745c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0ad000 tx=0x7f88ec008040 comp rx=0 tx=0).stop 2024-09-13T11:16:32.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc0ab080 msgr2=0x7f88fc1394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 --2- 172.21.15.39:0/2533057353 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f88fc0ab080 0x7f88fc1394b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c730 tx=0x7f88e400cbf0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f88fb7fe640 1 -- 172.21.15.39:0/2533057353 reap_dead start 2024-09-13T11:16:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 shutdown_connections 2024-09-13T11:16:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 >> 172.21.15.39:0/2533057353 conn(0x7f88fc06d460 msgr2=0x7f88fc13d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 shutdown_connections 2024-09-13T11:16:32.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.805+0000 7f89016f2640 1 -- 172.21.15.39:0/2533057353 wait complete. 2024-09-13T11:16:32.828 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T11:16:32.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.945+0000 7fd74d139640 1 Processor -- start 2024-09-13T11:16:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.945+0000 7fd74d139640 1 -- start start 2024-09-13T11:16:32.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748072150 0x7fd748143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd74813d840 0x7fd74814e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd748074520 con 0x7fd748144130 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd748144920 con 0x7fd74813d840 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fd748073620 con 0x7fd748072150 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd746d9d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748072150 0x7fd748143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd73ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd748144130 0x7fd74813d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50134/0 (socket says 172.21.15.39:50134) 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd73ffff640 1 -- 172.21.15.39:0/3631189399 learned_addr learned my addr 172.21.15.39:0/3631189399 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74759e640 1 --2- 172.21.15.39:0/3631189399 >> v2:172.21.15.39:3300/0 conn(0x7fd74813d840 0x7fd74814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd746d9d640 1 -- 172.21.15.39:0/3631189399 >> v2:172.21.15.39:3300/0 conn(0x7fd74813d840 msgr2=0x7fd74814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd746d9d640 1 --2- 172.21.15.39:0/3631189399 >> v2:172.21.15.39:3300/0 conn(0x7fd74813d840 0x7fd74814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd746d9d640 1 -- 172.21.15.39:0/3631189399 >> v1:172.21.15.39:6789/0 conn(0x7fd748144130 legacy=0x7fd74813d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd746d9d640 1 -- 172.21.15.39:0/3631189399 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd748073320 con 0x7fd748072150 2024-09-13T11:16:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd746d9d640 1 --2- 172.21.15.39:0/3631189399 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748072150 0x7fd748143bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097c0 tx=0x7fd73801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d4207571ed8f9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74659c640 1 -- 172.21.15.39:0/3631189399 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380b2070 con 0x7fd748072150 2024-09-13T11:16:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74659c640 1 -- 172.21.15.39:0/3631189399 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7380ad640 con 0x7fd748072150 2024-09-13T11:16:32.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74659c640 1 -- 172.21.15.39:0/3631189399 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7380ada10 con 0x7fd748072150 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- 172.21.15.39:0/3631189399 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748072150 msgr2=0x7fd748143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 --2- 172.21.15.39:0/3631189399 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748072150 0x7fd748143bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097c0 tx=0x7fd73801c480 comp rx=0 tx=0).stop 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- 172.21.15.39:0/3631189399 shutdown_connections 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 --2- 172.21.15.39:0/3631189399 >> v2:172.21.15.39:3300/0 conn(0x7fd74813d840 0x7fd74814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 --2- 172.21.15.39:0/3631189399 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748072150 0x7fd748143bf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- 172.21.15.39:0/3631189399 >> 172.21.15.39:0/3631189399 conn(0x7fd7480b9d70 msgr2=0x7fd7480ba180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- 172.21.15.39:0/3631189399 shutdown_connections 2024-09-13T11:16:32.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.949+0000 7fd74d139640 1 -- 172.21.15.39:0/3631189399 wait complete. 2024-09-13T11:16:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 Processor -- start 2024-09-13T11:16:32.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 -- start start 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748072150 0x7fd74813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 0x7fd748137900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 0x7fd748137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd74813dc50 con 0x7fd74813d840 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd748144720 con 0x7fd748072150 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fd748150ef0 con 0x7fd748144130 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 0x7fd748137900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 0x7fd748137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 0x7fd748137900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35932/0 (socket says 172.21.15.39:35932) 2024-09-13T11:16:32.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74759e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 0x7fd748137e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57294/0 (socket says 172.21.15.39:57294) 2024-09-13T11:16:32.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 -- 172.21.15.39:0/486471294 learned_addr learned my addr 172.21.15.39:0/486471294 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 -- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 msgr2=0x7fd748137e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 0x7fd748137e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 -- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748072150 msgr2=0x7fd74813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748072150 0x7fd74813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 -- 172.21.15.39:0/486471294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74813fb60 con 0x7fd74813d840 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74759e640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 0x7fd748137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73ffff640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 0x7fd748137900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd73000c400 tx=0x7fd73000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730017070 con 0x7fd74813d840 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd730005d10 con 0x7fd74813d840 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74813e7b0 con 0x7fd74813d840 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730007310 con 0x7fd74813d840 2024-09-13T11:16:32.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.953+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd748133e30 con 0x7fd74813d840 2024-09-13T11:16:32.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.957+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd748143bd0 con 0x7fd74813d840 2024-09-13T11:16:32.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.957+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fd73001a070 con 0x7fd74813d840 2024-09-13T11:16:32.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.957+0000 7fd73f7fe640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fd728072100 0x7fd7280745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:32.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.957+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7fd730091c60 con 0x7fd74813d840 2024-09-13T11:16:32.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.957+0000 7fd746d9d640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fd728072100 0x7fd7280745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:32.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.957+0000 7fd746d9d640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fd728072100 0x7fd7280745c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7380af000 tx=0x7fd738004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:32.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:32.961+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd73005cfa0 con 0x7fd74813d840 2024-09-13T11:16:33.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.149+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd748074ab0 con 0x7fd728072100 2024-09-13T11:16:33.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd73f7fe640 1 -- 172.21.15.39:0/486471294 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd748074ab0 con 0x7fd728072100 2024-09-13T11:16:33.156 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T11:16:33.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fd728072100 msgr2=0x7fd7280745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fd728072100 0x7fd7280745c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7380af000 tx=0x7fd738004740 comp rx=0 tx=0).stop 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 msgr2=0x7fd748137900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 0x7fd748137900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd73000c400 tx=0x7fd73000c8c0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 shutdown_connections 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fd728072100 0x7fd7280745c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fd748144130 0x7fd748137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd74813d840 0x7fd748137900 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 --2- 172.21.15.39:0/486471294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd748072150 0x7fd74813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 >> 172.21.15.39:0/486471294 conn(0x7fd7480b9d70 msgr2=0x7fd748146d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 shutdown_connections 2024-09-13T11:16:33.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.153+0000 7fd74d139640 1 -- 172.21.15.39:0/486471294 wait complete. 2024-09-13T11:16:33.174 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T11:16:33.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:33.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 Processor -- start 2024-09-13T11:16:33.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 -- start start 2024-09-13T11:16:33.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa608144220 0x7fa608073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 0x7fa60813d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60806f820 con 0x7fa608069140 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa6080725a0 con 0x7fa608144220 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60e68e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa608069520 con 0x7fa608072110 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 0x7fa60813d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 0x7fa60813d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57310/0 (socket says 172.21.15.39:57310) 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 -- 172.21.15.39:0/3272314747 learned_addr learned my addr 172.21.15.39:0/3272314747 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 -- 172.21.15.39:0/3272314747 >> v2:172.21.15.102:3300/0 conn(0x7fa608144220 msgr2=0x7fa608073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa6077fe640 1 --2- 172.21.15.39:0/3272314747 >> v2:172.21.15.102:3300/0 conn(0x7fa608144220 0x7fa608073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 --2- 172.21.15.39:0/3272314747 >> v2:172.21.15.102:3300/0 conn(0x7fa608144220 0x7fa608073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 -- 172.21.15.39:0/3272314747 >> v1:172.21.15.102:6789/0 conn(0x7fa608069140 legacy=0x7fa608143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa60cc2b640 1 -- 172.21.15.39:0/3272314747 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa608074350 con 0x7fa608072110 2024-09-13T11:16:33.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.301+0000 7fa6077fe640 1 --2- 172.21.15.39:0/3272314747 >> v2:172.21.15.102:3300/0 conn(0x7fa608144220 0x7fa608073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:16:33.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60cc2b640 1 --2- 172.21.15.39:0/3272314747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 0x7fa60813d630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa600009e50 tx=0x7fa60001c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f8b0ddba678519 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa606ffd640 1 -- 172.21.15.39:0/3272314747 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a55c0 con 0x7fa608072110 2024-09-13T11:16:33.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa606ffd640 1 -- 172.21.15.39:0/3272314747 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6000a5760 con 0x7fa608072110 2024-09-13T11:16:33.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa606ffd640 1 -- 172.21.15.39:0/3272314747 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a5b30 con 0x7fa608072110 2024-09-13T11:16:33.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- 172.21.15.39:0/3272314747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 msgr2=0x7fa60813d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 --2- 172.21.15.39:0/3272314747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 0x7fa60813d630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa600009e50 tx=0x7fa60001c980 comp rx=0 tx=0).stop 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- 172.21.15.39:0/3272314747 shutdown_connections 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 --2- 172.21.15.39:0/3272314747 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608072110 0x7fa60813d630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 --2- 172.21.15.39:0/3272314747 >> v2:172.21.15.102:3300/0 conn(0x7fa608144220 0x7fa608073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- 172.21.15.39:0/3272314747 >> 172.21.15.39:0/3272314747 conn(0x7fa60806c940 msgr2=0x7fa60806cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- 172.21.15.39:0/3272314747 shutdown_connections 2024-09-13T11:16:33.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- 172.21.15.39:0/3272314747 wait complete. 2024-09-13T11:16:33.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 Processor -- start 2024-09-13T11:16:33.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- start start 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608069140 0x7fa6080b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa608072110 0x7fa608146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa608146350 0x7fa6081472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa608150e50 con 0x7fa608072110 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa60813df80 con 0x7fa608146350 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60e68e640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fa608150fd0 con 0x7fa608069140 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa607fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608069140 0x7fa6080b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa608072110 0x7fa608146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa607fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608069140 0x7fa6080b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57320/0 (socket says 172.21.15.39:57320) 2024-09-13T11:16:33.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa607fff640 1 -- 172.21.15.39:0/2998775816 learned_addr learned my addr 172.21.15.39:0/2998775816 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa608072110 0x7fa608146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35942/0 (socket says 172.21.15.39:35942) 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.305+0000 7fa60cc2b640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa608146350 0x7fa6081472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa607fff640 1 -- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa608146350 msgr2=0x7fa6081472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa607fff640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa608146350 0x7fa6081472c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa607fff640 1 -- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa608072110 msgr2=0x7fa608146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa607fff640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa608072110 0x7fa608146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa607fff640 1 -- 172.21.15.39:0/2998775816 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60813eba0 con 0x7fa608069140 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa6077fe640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa608072110 0x7fa608146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa607fff640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608069140 0x7fa6080b0db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c450 tx=0x7fa5f800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8012830 con 0x7fa608069140 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f8017070 con 0x7fa608069140 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6081467e0 con 0x7fa608069140 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8012c30 con 0x7fa608069140 2024-09-13T11:16:33.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa608139580 con 0x7fa608069140 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa60813d630 con 0x7fa608069140 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fa5f801c460 con 0x7fa608069140 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa5e8072100 0x7fa5e80745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7fa5f8092680 con 0x7fa608069140 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fa5e80792c0 0x7fa5e807b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 --> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5f8020ec0 con 0x7fa5e80792c0 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa5f8099050 con 0x7fa608069140 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa6077fe640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa5e8072100 0x7fa5e80745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa60cc2b640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fa5e80792c0 0x7fa5e807b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.309+0000 7fa60cc2b640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fa5e80792c0 0x7fa5e807b6e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.313+0000 7fa6077fe640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa5e8072100 0x7fa5e80745c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.313+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== osd.2 v2:172.21.15.39:6824/1540683038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5f8020ec0 con 0x7fa5e80792c0 2024-09-13T11:16:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 --> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa608144220 con 0x7fa5e80792c0 2024-09-13T11:16:33.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa604ff9640 1 -- 172.21.15.39:0/2998775816 <== osd.2 v2:172.21.15.39:6824/1540683038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa608144220 con 0x7fa5e80792c0 2024-09-13T11:16:33.330 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:33.330 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:33.330 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fa5e80792c0 msgr2=0x7fa5e807b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:6824/1540683038,v1:172.21.15.39:6825/1540683038] conn(0x7fa5e80792c0 0x7fa5e807b6e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa5e8072100 msgr2=0x7fa5e80745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fa5e8072100 0x7fa5e80745c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0008040 comp rx=0 tx=0).stop 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608069140 msgr2=0x7fa6080b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 --2- 172.21.15.39:0/2998775816 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fa608069140 0x7fa6080b0db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c450 tx=0x7fa5f800c910 comp rx=0 tx=0).stop 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60cc2b640 1 -- 172.21.15.39:0/2998775816 reap_dead start 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 shutdown_connections 2024-09-13T11:16:33.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 >> 172.21.15.39:0/2998775816 conn(0x7fa60806c940 msgr2=0x7fa60813cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 shutdown_connections 2024-09-13T11:16:33.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.325+0000 7fa60e68e640 1 -- 172.21.15.39:0/2998775816 wait complete. 2024-09-13T11:16:33.346 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T11:16:33.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8703a86640 1 Processor -- start 2024-09-13T11:16:33.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8703a86640 1 -- start start 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8703a86640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8703a86640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86fc0b2db0 con 0x7f86fc1418c0 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8703a86640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86fc0ac320 con 0x7f86fc0b29d0 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8703a86640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f86fc0ac600 con 0x7f86fc137d10 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8702023640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f86fc1418c0 0x7f86fc141d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50142/0 (socket says 172.21.15.39:50142) 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8702023640 1 -- 172.21.15.39:0/1999140473 learned_addr learned my addr 172.21.15.39:0/1999140473 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8701021640 1 --2- 172.21.15.39:0/1999140473 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8700820640 1 -- 172.21.15.39:0/1999140473 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022938287 0 0) 0x7f86f40014a0 con 0x7f86fc1418c0 2024-09-13T11:16:33.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8700820640 1 -- 172.21.15.39:0/1999140473 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86e8003530 con 0x7f86fc1418c0 2024-09-13T11:16:33.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8701021640 1 -- 172.21.15.39:0/1999140473 >> v1:172.21.15.102:6789/0 conn(0x7f86fc0b29d0 legacy=0x7f86fc145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8701021640 1 -- 172.21.15.39:0/1999140473 >> v1:172.21.15.39:6789/0 conn(0x7f86fc1418c0 legacy=0x7f86fc141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.453+0000 7f8701021640 1 -- 172.21.15.39:0/1999140473 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc145a00 con 0x7f86fc137d10 2024-09-13T11:16:33.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8701021640 1 --2- 172.21.15.39:0/1999140473 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc138150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097f0 tx=0x7f86ec01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e87b1344ae735fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8700820640 1 -- 172.21.15.39:0/1999140473 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0b0070 con 0x7f86fc137d10 2024-09-13T11:16:33.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8700820640 1 -- 172.21.15.39:0/1999140473 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec0ab600 con 0x7f86fc137d10 2024-09-13T11:16:33.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8700820640 1 -- 172.21.15.39:0/1999140473 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0ab9b0 con 0x7f86fc137d10 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- 172.21.15.39:0/1999140473 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 msgr2=0x7f86fc138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 --2- 172.21.15.39:0/1999140473 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc138150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097f0 tx=0x7f86ec01c430 comp rx=0 tx=0).stop 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- 172.21.15.39:0/1999140473 shutdown_connections 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 --2- 172.21.15.39:0/1999140473 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc138150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- 172.21.15.39:0/1999140473 >> 172.21.15.39:0/1999140473 conn(0x7f86fc0b5dd0 msgr2=0x7f86fc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- 172.21.15.39:0/1999140473 shutdown_connections 2024-09-13T11:16:33.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- 172.21.15.39:0/1999140473 wait complete. 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 Processor -- start 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- start start 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86fc0b29d0 0x7f86fc13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc13bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 0x7f86fc1387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc14fbe0 con 0x7f86fc1418c0 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc14fa60 con 0x7f86fc0b29d0 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.457+0000 7f8703a86640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f86fc14fd60 con 0x7f86fc137d10 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 0x7f86fc1387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8701021640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc13bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 0x7f86fc1387c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35952/0 (socket says 172.21.15.39:35952) 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8701021640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc13bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57342/0 (socket says 172.21.15.39:57342) 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 -- 172.21.15.39:0/2445184291 learned_addr learned my addr 172.21.15.39:0/2445184291 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8701822640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86fc0b29d0 0x7f86fc13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 -- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 msgr2=0x7f86fc13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc13bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 -- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86fc0b29d0 msgr2=0x7f86fc13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86fc0b29d0 0x7f86fc13e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 -- 172.21.15.39:0/2445184291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc138d00 con 0x7f86fc1418c0 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8702023640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 0x7f86fc1387c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86f400cae0 tx=0x7f86f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f400ac40 con 0x7f86fc1418c0 2024-09-13T11:16:33.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f400ade0 con 0x7f86fc1418c0 2024-09-13T11:16:33.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc13eb30 con 0x7f86fc1418c0 2024-09-13T11:16:33.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4012620 con 0x7f86fc1418c0 2024-09-13T11:16:33.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1ddaa0 con 0x7f86fc1418c0 2024-09-13T11:16:33.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc138150 con 0x7f86fc1418c0 2024-09-13T11:16:33.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f86f40127c0 con 0x7f86fc1418c0 2024-09-13T11:16:33.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f86f27fc640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f86e0072100 0x7f86e00745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f86f4092ec0 con 0x7f86fc1418c0 2024-09-13T11:16:33.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8701822640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f86e0072100 0x7f86e00745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.461+0000 7f8701822640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f86e0072100 0x7f86e00745c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86f80016f0 tx=0x7f86f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.465+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f86fc0b2db0 con 0x7f86fc1418c0 2024-09-13T11:16:33.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.629+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f86fc070f90 con 0x7f86e0072100 2024-09-13T11:16:33.635 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.629+0000 7f86f27fc640 1 -- 172.21.15.39:0/2445184291 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f86fc070f90 con 0x7f86e0072100 2024-09-13T11:16:33.635 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T11:16:33.637 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f86e0072100 msgr2=0x7f86e00745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f86e0072100 0x7f86e00745c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86f80016f0 tx=0x7f86f8009040 comp rx=0 tx=0).stop 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 msgr2=0x7f86fc1387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 0x7f86fc1387c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f86f400cae0 tx=0x7f86f400a060 comp rx=0 tx=0).stop 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 shutdown_connections 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f86e0072100 0x7f86e00745c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86fc1418c0 0x7f86fc1387c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f86fc137d10 0x7f86fc13bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 --2- 172.21.15.39:0/2445184291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86fc0b29d0 0x7f86fc13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 >> 172.21.15.39:0/2445184291 conn(0x7f86fc0b5dd0 msgr2=0x7f86fc135d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 shutdown_connections 2024-09-13T11:16:33.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.633+0000 7f8703a86640 1 -- 172.21.15.39:0/2445184291 wait complete. 2024-09-13T11:16:33.653 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T11:16:33.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.765+0000 7f0b23797640 1 Processor -- start 2024-09-13T11:16:33.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.765+0000 7f0b23797640 1 -- start start 2024-09-13T11:16:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0b1c13da30 0x7f0b1c144d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 0x7f0b1c1452d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1c074810 con 0x7f0b1c1470f0 2024-09-13T11:16:33.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0b1c0b6290 con 0x7f0b1c13da30 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1c0b74b0 con 0x7f0b1c1474d0 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 0x7f0b1c1452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 0x7f0b1c1452d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57346/0 (socket says 172.21.15.39:57346) 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 -- 172.21.15.39:0/3788315557 learned_addr learned my addr 172.21.15.39:0/3788315557 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b20d32640 1 --2- 172.21.15.39:0/3788315557 >> v2:172.21.15.102:3300/0 conn(0x7f0b1c13da30 0x7f0b1c144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 -- 172.21.15.39:0/3788315557 >> v2:172.21.15.102:3300/0 conn(0x7f0b1c13da30 msgr2=0x7f0b1c144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 --2- 172.21.15.39:0/3788315557 >> v2:172.21.15.102:3300/0 conn(0x7f0b1c13da30 0x7f0b1c144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 -- 172.21.15.39:0/3788315557 >> v1:172.21.15.102:6789/0 conn(0x7f0b1c1470f0 legacy=0x7f0b1c13d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:33.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 -- 172.21.15.39:0/3788315557 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c1449b0 con 0x7f0b1c1474d0 2024-09-13T11:16:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b21d34640 1 --2- 172.21.15.39:0/3788315557 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 0x7f0b1c1452d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009e50 tx=0x7f0b1401c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93badb07521a89bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b13fff640 1 -- 172.21.15.39:0/3788315557 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b140a56d0 con 0x7f0b1c1474d0 2024-09-13T11:16:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b13fff640 1 -- 172.21.15.39:0/3788315557 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c145c20 con 0x7f0b1c1474d0 2024-09-13T11:16:33.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b13fff640 1 -- 172.21.15.39:0/3788315557 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b140a5a90 con 0x7f0b1c1474d0 2024-09-13T11:16:33.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 -- 172.21.15.39:0/3788315557 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 msgr2=0x7f0b1c1452d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 --2- 172.21.15.39:0/3788315557 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 0x7f0b1c1452d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0b14009e50 tx=0x7f0b1401c980 comp rx=0 tx=0).stop 2024-09-13T11:16:33.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 -- 172.21.15.39:0/3788315557 shutdown_connections 2024-09-13T11:16:33.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 --2- 172.21.15.39:0/3788315557 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c1474d0 0x7f0b1c1452d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 --2- 172.21.15.39:0/3788315557 >> v2:172.21.15.102:3300/0 conn(0x7f0b1c13da30 0x7f0b1c144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.769+0000 7f0b23797640 1 -- 172.21.15.39:0/3788315557 >> 172.21.15.39:0/3788315557 conn(0x7f0b1c0b6450 msgr2=0x7f0b1c0b6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- 172.21.15.39:0/3788315557 shutdown_connections 2024-09-13T11:16:33.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- 172.21.15.39:0/3788315557 wait complete. 2024-09-13T11:16:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 Processor -- start 2024-09-13T11:16:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- start start 2024-09-13T11:16:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c13da30 0x7f0b1c142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b1c1470f0 0x7f0b1c1df150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1c1474d0 0x7f0b1c1df690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c150dd0 con 0x7f0b1c1470f0 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c150c50 con 0x7f0b1c1474d0 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1c150f50 con 0x7f0b1c13da30 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b1c1470f0 0x7f0b1c1df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b21533640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c13da30 0x7f0b1c142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b1c1470f0 0x7f0b1c1df150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35958/0 (socket says 172.21.15.39:35958) 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 -- 172.21.15.39:0/1528542825 learned_addr learned my addr 172.21.15.39:0/1528542825 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b21d34640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1c1474d0 0x7f0b1c1df690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 -- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c13da30 msgr2=0x7f0b1c142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c13da30 0x7f0b1c142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 -- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1c1474d0 msgr2=0x7f0b1c1df690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b1c1474d0 0x7f0b1c1df690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 -- 172.21.15.39:0/1528542825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c13ec10 con 0x7f0b1c1470f0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b21533640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0b1c13da30 0x7f0b1c142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b20d32640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b1c1470f0 0x7f0b1c1df150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c7f0 tx=0x7f0b0c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c015070 con 0x7f0b1c1470f0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c004240 con 0x7f0b1c1470f0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1c140f40 con 0x7f0b1c1470f0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c003620 con 0x7f0b1c1470f0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1c1336e0 con 0x7f0b1c1470f0 2024-09-13T11:16:33.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.773+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b1c145c20 con 0x7f0b1c1470f0 2024-09-13T11:16:33.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f0b0c0039d0 con 0x7f0b1c1470f0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0b00072100 0x7f0b000745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f0b0c092f60 con 0x7f0b1c1470f0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f0b000792c0 0x7f0b0007b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 --> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b0007bd90 con 0x7f0b000792c0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0b0c0933f0 con 0x7f0b1c1470f0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b21d34640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f0b000792c0 0x7f0b0007b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b21533640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0b00072100 0x7f0b000745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b21d34640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f0b000792c0 0x7f0b0007b6e0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b21533640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0b00072100 0x7f0b000745c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b18007fd0 tx=0x7f0b18007e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.783 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.777+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== osd.3 v2:172.21.15.39:6800/2999541781 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b0007bd90 con 0x7f0b000792c0 2024-09-13T11:16:33.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 --> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b1c1dfe20 con 0x7f0b000792c0 2024-09-13T11:16:33.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b11ffb640 1 -- 172.21.15.39:0/1528542825 <== osd.3 v2:172.21.15.39:6800/2999541781 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0b1c1dfe20 con 0x7f0b000792c0 2024-09-13T11:16:33.795 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:33.796 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:33.796 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f0b000792c0 msgr2=0x7f0b0007b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:6800/2999541781,v1:172.21.15.39:6801/2999541781] conn(0x7f0b000792c0 0x7f0b0007b6e0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0b00072100 msgr2=0x7f0b000745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0b00072100 0x7f0b000745c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0b18007fd0 tx=0x7f0b18007e40 comp rx=0 tx=0).stop 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b1c1470f0 msgr2=0x7f0b1c1df150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 --2- 172.21.15.39:0/1528542825 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0b1c1470f0 0x7f0b1c1df150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c7f0 tx=0x7f0b0c00ccb0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b21d34640 1 -- 172.21.15.39:0/1528542825 reap_dead start 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 shutdown_connections 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 >> 172.21.15.39:0/1528542825 conn(0x7f0b1c0b6450 msgr2=0x7f0b1c144d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 shutdown_connections 2024-09-13T11:16:33.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.789+0000 7f0b23797640 1 -- 172.21.15.39:0/1528542825 wait complete. 2024-09-13T11:16:33.810 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T11:16:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 Processor -- start 2024-09-13T11:16:33.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 -- start start 2024-09-13T11:16:33.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f228c0b7200 0x7f228c139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0b75e0 con 0x7f228c1473e0 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f228c071680 con 0x7f228c0b7200 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f229468d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f228c071e50 con 0x7f228c13a300 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f2292c2a640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f228c1473e0 0x7f228c06c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50150/0 (socket says 172.21.15.39:50150) 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f2292c2a640 1 -- 172.21.15.39:0/2203938575 learned_addr learned my addr 172.21.15.39:0/2203938575 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.917+0000 7f2291c28640 1 --2- 172.21.15.39:0/2203938575 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2292429640 1 --2- 172.21.15.39:0/2203938575 >> v2:172.21.15.102:3300/0 conn(0x7f228c0b7200 0x7f228c139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291427640 1 -- 172.21.15.39:0/2203938575 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703789695 0 0) 0x7f22840014a0 con 0x7f228c1473e0 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291427640 1 -- 172.21.15.39:0/2203938575 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2278003530 con 0x7f228c1473e0 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291c28640 1 -- 172.21.15.39:0/2203938575 >> v2:172.21.15.102:3300/0 conn(0x7f228c0b7200 msgr2=0x7f228c139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:33.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291c28640 1 --2- 172.21.15.39:0/2203938575 >> v2:172.21.15.102:3300/0 conn(0x7f228c0b7200 0x7f228c139dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291c28640 1 -- 172.21.15.39:0/2203938575 >> v1:172.21.15.39:6789/0 conn(0x7f228c1473e0 legacy=0x7f228c06c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291c28640 1 -- 172.21.15.39:0/2203938575 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c13a720 con 0x7f228c13a300 2024-09-13T11:16:33.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291c28640 1 --2- 172.21.15.39:0/2203938575 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c146ea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f227c0097c0 tx=0x7f227c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282e05712a17122d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291427640 1 -- 172.21.15.39:0/2203938575 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b0070 con 0x7f228c13a300 2024-09-13T11:16:33.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291427640 1 -- 172.21.15.39:0/2203938575 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0ab600 con 0x7f228c13a300 2024-09-13T11:16:33.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f2291427640 1 -- 172.21.15.39:0/2203938575 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0ab9d0 con 0x7f228c13a300 2024-09-13T11:16:33.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 -- 172.21.15.39:0/2203938575 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 msgr2=0x7f228c146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 --2- 172.21.15.39:0/2203938575 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c146ea0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f227c0097c0 tx=0x7f227c01c480 comp rx=0 tx=0).stop 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 -- 172.21.15.39:0/2203938575 shutdown_connections 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 --2- 172.21.15.39:0/2203938575 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c146ea0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 --2- 172.21.15.39:0/2203938575 >> v2:172.21.15.102:3300/0 conn(0x7f228c0b7200 0x7f228c139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 -- 172.21.15.39:0/2203938575 >> 172.21.15.39:0/2203938575 conn(0x7f228c06e200 msgr2=0x7f228c0b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 -- 172.21.15.39:0/2203938575 shutdown_connections 2024-09-13T11:16:33.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.921+0000 7f229468d640 1 -- 172.21.15.39:0/2203938575 wait complete. 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 Processor -- start 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- start start 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0b7200 0x7f228c14e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1473e0 0x7f228c142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f228c151250 con 0x7f228c1473e0 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f228c071af0 con 0x7f228c0b7200 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f228c1513d0 con 0x7f228c13a300 2024-09-13T11:16:33.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2292c2a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1473e0 0x7f228c142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c13cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57364/0 (socket says 172.21.15.39:57364) 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 -- 172.21.15.39:0/3183564822 learned_addr learned my addr 172.21.15.39:0/3183564822 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2292429640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0b7200 0x7f228c14e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 -- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0b7200 msgr2=0x7f228c14e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0b7200 0x7f228c14e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 -- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1473e0 msgr2=0x7f228c142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1473e0 0x7f228c142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 -- 172.21.15.39:0/3183564822 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c143ba0 con 0x7f228c13a300 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2291c28640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c13cc70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ae040 tx=0x7f227c019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0ba070 con 0x7f228c13a300 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c0b43f0 con 0x7f228c13a300 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c141440 con 0x7f228c13a300 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0b0040 con 0x7f228c13a300 2024-09-13T11:16:33.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c13d1b0 con 0x7f228c13a300 2024-09-13T11:16:33.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c139dc0 con 0x7f228c13a300 2024-09-13T11:16:33.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f227c0bd070 con 0x7f228c13a300 2024-09-13T11:16:33.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.925+0000 7f2282ffd640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f2270072100 0x7f22700745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:33.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.929+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f227c12b970 con 0x7f228c13a300 2024-09-13T11:16:33.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.929+0000 7f2292429640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f2270072100 0x7f22700745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:33.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.929+0000 7f2292429640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f2270072100 0x7f22700745c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2288009790 tx=0x7f2288008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:33.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:33.933+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f227c016070 con 0x7f228c13a300 2024-09-13T11:16:34.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f228c074ab0 con 0x7f2270072100 2024-09-13T11:16:34.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f2282ffd640 1 -- 172.21.15.39:0/3183564822 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f228c074ab0 con 0x7f2270072100 2024-09-13T11:16:34.133 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f2270072100 msgr2=0x7f22700745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f2270072100 0x7f22700745c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2288009790 tx=0x7f2288008040 comp rx=0 tx=0).stop 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 msgr2=0x7f228c13cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c13cc70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ae040 tx=0x7f227c019220 comp rx=0 tx=0).stop 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 shutdown_connections 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f2270072100 0x7f22700745c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c1473e0 0x7f228c142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f228c13a300 0x7f228c13cc70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 --2- 172.21.15.39:0/3183564822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0b7200 0x7f228c14e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 >> 172.21.15.39:0/3183564822 conn(0x7f228c06e200 msgr2=0x7f228c0b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 shutdown_connections 2024-09-13T11:16:34.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.129+0000 7f229468d640 1 -- 172.21.15.39:0/3183564822 wait complete. 2024-09-13T11:16:34.152 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T11:16:34.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.265+0000 7f00f2e99640 1 Processor -- start 2024-09-13T11:16:34.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.265+0000 7f00f2e99640 1 -- start start 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f00ec0738b0 0x7f00ec13d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec13dc40 0x7f00ec143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00ec073c90 con 0x7f00ec144130 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f00ec0ab6b0 con 0x7f00ec0738b0 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec072ba0 con 0x7f00ec13dc40 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f1436640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f00ec144130 0x7f00ec071400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50158/0 (socket says 172.21.15.39:50158) 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec13dc40 0x7f00ec143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f0c35640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f00ec0738b0 0x7f00ec13d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f1436640 1 -- 172.21.15.39:0/939352610 learned_addr learned my addr 172.21.15.39:0/939352610 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:34.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00ebfff640 1 -- 172.21.15.39:0/939352610 >> v2:172.21.15.39:3300/0 conn(0x7f00ec0738b0 msgr2=0x7f00ec13d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00ebfff640 1 --2- 172.21.15.39:0/939352610 >> v2:172.21.15.39:3300/0 conn(0x7f00ec0738b0 0x7f00ec13d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00ebfff640 1 -- 172.21.15.39:0/939352610 >> v1:172.21.15.39:6789/0 conn(0x7f00ec144130 legacy=0x7f00ec071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00ebfff640 1 -- 172.21.15.39:0/939352610 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec0b2130 con 0x7f00ec13dc40 2024-09-13T11:16:34.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f0c35640 1 --2- 172.21.15.39:0/939352610 >> v2:172.21.15.39:3300/0 conn(0x7f00ec0738b0 0x7f00ec13d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:34.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00ebfff640 1 --2- 172.21.15.39:0/939352610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec13dc40 0x7f00ec143bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e001c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a73f3957b61ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00eb7fe640 1 -- 172.21.15.39:0/939352610 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00b0070 con 0x7f00ec13dc40 2024-09-13T11:16:34.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00eb7fe640 1 -- 172.21.15.39:0/939352610 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e00ab600 con 0x7f00ec13dc40 2024-09-13T11:16:34.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00eb7fe640 1 -- 172.21.15.39:0/939352610 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00ab9d0 con 0x7f00ec13dc40 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- 172.21.15.39:0/939352610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec13dc40 msgr2=0x7f00ec143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 --2- 172.21.15.39:0/939352610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec13dc40 0x7f00ec143bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00e00097c0 tx=0x7f00e001c360 comp rx=0 tx=0).stop 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- 172.21.15.39:0/939352610 shutdown_connections 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 --2- 172.21.15.39:0/939352610 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec13dc40 0x7f00ec143bf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 --2- 172.21.15.39:0/939352610 >> v2:172.21.15.39:3300/0 conn(0x7f00ec0738b0 0x7f00ec13d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- 172.21.15.39:0/939352610 >> 172.21.15.39:0/939352610 conn(0x7f00ec06d460 msgr2=0x7f00ec0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- 172.21.15.39:0/939352610 shutdown_connections 2024-09-13T11:16:34.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.269+0000 7f00f2e99640 1 -- 172.21.15.39:0/939352610 wait complete. 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 Processor -- start 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- start start 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec0738b0 0x7f00ec135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ec13dc40 0x7f00ec143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ec144130 0x7f00ec143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec0700c0 con 0x7f00ec13dc40 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00ec06ff40 con 0x7f00ec144130 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f00ec073010 con 0x7f00ec0738b0 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f0c35640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec0738b0 0x7f00ec135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ec13dc40 0x7f00ec143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f0c35640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec0738b0 0x7f00ec135d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57384/0 (socket says 172.21.15.39:57384) 2024-09-13T11:16:34.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f0c35640 1 -- 172.21.15.39:0/428885905 learned_addr learned my addr 172.21.15.39:0/428885905 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ec13dc40 0x7f00ec143330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35982/0 (socket says 172.21.15.39:35982) 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 -- 172.21.15.39:0/428885905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec0738b0 msgr2=0x7f00ec135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec0738b0 0x7f00ec135d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 -- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ec144130 msgr2=0x7f00ec143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00ec144130 0x7f00ec143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 -- 172.21.15.39:0/428885905 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ec0ad720 con 0x7f00ec13dc40 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f0c35640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f00ec0738b0 0x7f00ec135d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00ebfff640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ec13dc40 0x7f00ec143330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ab000 tx=0x7f00e0019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00b0040 con 0x7f00ec13dc40 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e00b9070 con 0x7f00ec13dc40 2024-09-13T11:16:34.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00b4670 con 0x7f00ec13dc40 2024-09-13T11:16:34.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ec0abff0 con 0x7f00ec13dc40 2024-09-13T11:16:34.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ec0b1310 con 0x7f00ec13dc40 2024-09-13T11:16:34.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00ec13d700 con 0x7f00ec13dc40 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f00e00b4810 con 0x7f00ec13dc40 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.273+0000 7f00e97fa640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f00d8072100 0x7f00d80745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f00e012d130 con 0x7f00ec13dc40 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00e97fa640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f00d80792c0 0x7f00d807b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 --> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00e00c8e50 con 0x7f00d80792c0 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00e012d5c0 con 0x7f00ec13dc40 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00f0c35640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f00d8072100 0x7f00d80745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00f1436640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f00d80792c0 0x7f00d807b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00f0c35640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f00d8072100 0x7f00d80745c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009bd0 tx=0x7f00dc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00f1436640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f00d80792c0 0x7f00d807b6e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.277+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== osd.4 v2:172.21.15.102:6816/3161248300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00e00c8e50 con 0x7f00d80792c0 2024-09-13T11:16:34.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.289+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 --> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f00ec13b4e0 con 0x7f00d80792c0 2024-09-13T11:16:34.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00e97fa640 1 -- 172.21.15.39:0/428885905 <== osd.4 v2:172.21.15.102:6816/3161248300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f00ec13b4e0 con 0x7f00d80792c0 2024-09-13T11:16:34.296 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:34.297 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:34.297 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f00d80792c0 msgr2=0x7f00d807b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6816/3161248300,v1:172.21.15.102:6817/3161248300] conn(0x7f00d80792c0 0x7f00d807b6e0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f00d8072100 msgr2=0x7f00d80745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f00d8072100 0x7f00d80745c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009bd0 tx=0x7f00dc00b040 comp rx=0 tx=0).stop 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ec13dc40 msgr2=0x7f00ec143330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 --2- 172.21.15.39:0/428885905 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00ec13dc40 0x7f00ec143330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ab000 tx=0x7f00e0019100 comp rx=0 tx=0).stop 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f1436640 1 -- 172.21.15.39:0/428885905 reap_dead start 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 shutdown_connections 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 >> 172.21.15.39:0/428885905 conn(0x7f00ec06d460 msgr2=0x7f00ec14b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 shutdown_connections 2024-09-13T11:16:34.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.293+0000 7f00f2e99640 1 -- 172.21.15.39:0/428885905 wait complete. 2024-09-13T11:16:34.312 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T11:16:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 Processor -- start 2024-09-13T11:16:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 -- start start 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1e040b7190 0x7f1e04072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1e04140050 0x7f1e04143f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e040b7570 con 0x7f1e04143b00 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1e040ab090 con 0x7f1e040b7190 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e088d1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1e04072590 con 0x7f1e04140050 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0259c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1e040b7190 0x7f1e04072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e01d9b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1e04143b00 0x7f1e0413f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50174/0 (socket says 172.21.15.39:50174) 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0259c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1e040b7190 0x7f1e04072a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35986/0 (socket says 172.21.15.39:35986) 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e01d9b640 1 -- 172.21.15.39:0/1698043689 learned_addr learned my addr 172.21.15.39:0/1698043689 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e02d9d640 1 --2- 172.21.15.39:0/1698043689 >> v2:172.21.15.102:3300/0 conn(0x7f1e04140050 0x7f1e04143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0259c640 1 -- 172.21.15.39:0/1698043689 >> v2:172.21.15.102:3300/0 conn(0x7f1e04140050 msgr2=0x7f1e04143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0259c640 1 --2- 172.21.15.39:0/1698043689 >> v2:172.21.15.102:3300/0 conn(0x7f1e04140050 0x7f1e04143f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0259c640 1 -- 172.21.15.39:0/1698043689 >> v1:172.21.15.39:6789/0 conn(0x7f1e04143b00 legacy=0x7f1e0413f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0259c640 1 -- 172.21.15.39:0/1698043689 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e040ab2c0 con 0x7f1e040b7190 2024-09-13T11:16:34.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.417+0000 7f1e0159a640 1 -- 172.21.15.39:0/1698043689 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552494683 0 0) 0x7f1df8001120 con 0x7f1e04143b00 2024-09-13T11:16:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e0259c640 1 --2- 172.21.15.39:0/1698043689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e040b7190 0x7f1e04072a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e04144460 tx=0x7f1df401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0fb18e6e67ab57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e0159a640 1 -- 172.21.15.39:0/1698043689 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b1070 con 0x7f1e040b7190 2024-09-13T11:16:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e0159a640 1 -- 172.21.15.39:0/1698043689 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df40ac620 con 0x7f1e040b7190 2024-09-13T11:16:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e0159a640 1 -- 172.21.15.39:0/1698043689 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40ac9f0 con 0x7f1e040b7190 2024-09-13T11:16:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 -- 172.21.15.39:0/1698043689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e040b7190 msgr2=0x7f1e04072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 --2- 172.21.15.39:0/1698043689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e040b7190 0x7f1e04072a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e04144460 tx=0x7f1df401c3a0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 -- 172.21.15.39:0/1698043689 shutdown_connections 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 --2- 172.21.15.39:0/1698043689 >> v2:172.21.15.102:3300/0 conn(0x7f1e04140050 0x7f1e04143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 --2- 172.21.15.39:0/1698043689 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e040b7190 0x7f1e04072a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 -- 172.21.15.39:0/1698043689 >> 172.21.15.39:0/1698043689 conn(0x7f1e0406e110 msgr2=0x7f1e040b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 -- 172.21.15.39:0/1698043689 shutdown_connections 2024-09-13T11:16:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.421+0000 7f1e088d1640 1 -- 172.21.15.39:0/1698043689 wait complete. 2024-09-13T11:16:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 Processor -- start 2024-09-13T11:16:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- start start 2024-09-13T11:16:34.430 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1e040b7190 0x7f1e041494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e04140050 0x7f1e0414d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e04143b00 0x7f1e04135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0414b820 con 0x7f1e04140050 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0414b6a0 con 0x7f1e04143b00 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0414b9a0 con 0x7f1e040b7190 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e0259c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1e040b7190 0x7f1e041494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e0259c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1e040b7190 0x7f1e041494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57394/0 (socket says 172.21.15.39:57394) 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e04140050 0x7f1e0414d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e0259c640 1 -- 172.21.15.39:0/894275017 learned_addr learned my addr 172.21.15.39:0/894275017 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e02d9d640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e04143b00 0x7f1e04135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 -- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1e040b7190 msgr2=0x7f1e041494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1e040b7190 0x7f1e041494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 -- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e04143b00 msgr2=0x7f1e04135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e04143b00 0x7f1e04135db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 -- 172.21.15.39:0/894275017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0414d750 con 0x7f1e04140050 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e02d9d640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e04143b00 0x7f1e04135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e01d9b640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e04140050 0x7f1e0414d0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1df800c3c0 tx=0x7f1df800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80074e0 con 0x7f1e04140050 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df80047f0 con 0x7f1e04140050 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0414c600 con 0x7f1e04140050 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8004be0 con 0x7f1e04140050 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e041364c0 con 0x7f1e04140050 2024-09-13T11:16:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e04141270 con 0x7f1e04140050 2024-09-13T11:16:34.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f1df8011070 con 0x7f1e04140050 2024-09-13T11:16:34.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1df2ffd640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f1de4072100 0x7f1de40745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f1df80922d0 con 0x7f1e04140050 2024-09-13T11:16:34.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.425+0000 7f1e0259c640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f1de4072100 0x7f1de40745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.429+0000 7f1e0259c640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f1de4072100 0x7f1de40745c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1df401c3e0 tx=0x7f1df40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.429+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1e040b7570 con 0x7f1e04140050 2024-09-13T11:16:34.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f1e04143ee0 con 0x7f1de4072100 2024-09-13T11:16:34.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1df2ffd640 1 -- 172.21.15.39:0/894275017 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1e04143ee0 con 0x7f1de4072100 2024-09-13T11:16:34.617 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f1de4072100 msgr2=0x7f1de40745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f1de4072100 0x7f1de40745c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1df401c3e0 tx=0x7f1df40a7000 comp rx=0 tx=0).stop 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e04140050 msgr2=0x7f1e0414d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e04140050 0x7f1e0414d0a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1df800c3c0 tx=0x7f1df800c880 comp rx=0 tx=0).stop 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 shutdown_connections 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f1de4072100 0x7f1de40745c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e04143b00 0x7f1e04135db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e04140050 0x7f1e0414d0a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 --2- 172.21.15.39:0/894275017 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f1e040b7190 0x7f1e041494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 >> 172.21.15.39:0/894275017 conn(0x7f1e0406e110 msgr2=0x7f1e0413c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 shutdown_connections 2024-09-13T11:16:34.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.613+0000 7f1e088d1640 1 -- 172.21.15.39:0/894275017 wait complete. 2024-09-13T11:16:34.639 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T11:16:34.639 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:34.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 Processor -- start 2024-09-13T11:16:34.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 -- start start 2024-09-13T11:16:34.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbf8c069140 0x7fbf8c0729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbf8c071fc0 0x7fbf8c146f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf8c06f820 con 0x7fbf8c074130 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8c069520 con 0x7fbf8c071fc0 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf91ace640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbf8c072ef0 con 0x7fbf8c069140 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8b7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbf8c069140 0x7fbf8c0729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8bfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fbf8c074130 0x7fbf8c140a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.39:50430/0 (socket says 172.21.15.39:50430) 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8bfff640 1 -- 172.21.15.39:0/425269298 learned_addr learned my addr 172.21.15.39:0/425269298 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8affd640 1 --2- 172.21.15.39:0/425269298 >> v2:172.21.15.39:3300/0 conn(0x7fbf8c071fc0 0x7fbf8c146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8affd640 1 -- 172.21.15.39:0/425269298 >> v2:172.21.15.102:3300/0 conn(0x7fbf8c069140 msgr2=0x7fbf8c0729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8affd640 1 --2- 172.21.15.39:0/425269298 >> v2:172.21.15.102:3300/0 conn(0x7fbf8c069140 0x7fbf8c0729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8affd640 1 -- 172.21.15.39:0/425269298 >> v1:172.21.15.102:6789/0 conn(0x7fbf8c074130 legacy=0x7fbf8c140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.757+0000 7fbf8affd640 1 -- 172.21.15.39:0/425269298 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c073230 con 0x7fbf8c071fc0 2024-09-13T11:16:34.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8affd640 1 --2- 172.21.15.39:0/425269298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c071fc0 0x7fbf8c146f60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c06a330 tx=0x7fbf8001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43fdf94a9e35ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8a7fc640 1 -- 172.21.15.39:0/425269298 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf800ab5f0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8a7fc640 1 -- 172.21.15.39:0/425269298 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf800b0070 con 0x7fbf8c071fc0 2024-09-13T11:16:34.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8a7fc640 1 -- 172.21.15.39:0/425269298 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf800ab9b0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- 172.21.15.39:0/425269298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c071fc0 msgr2=0x7fbf8c146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 --2- 172.21.15.39:0/425269298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c071fc0 0x7fbf8c146f60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c06a330 tx=0x7fbf8001c3d0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- 172.21.15.39:0/425269298 shutdown_connections 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 --2- 172.21.15.39:0/425269298 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c071fc0 0x7fbf8c146f60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 --2- 172.21.15.39:0/425269298 >> v2:172.21.15.102:3300/0 conn(0x7fbf8c069140 0x7fbf8c0729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- 172.21.15.39:0/425269298 >> 172.21.15.39:0/425269298 conn(0x7fbf8c06c940 msgr2=0x7fbf8c06cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- 172.21.15.39:0/425269298 shutdown_connections 2024-09-13T11:16:34.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- 172.21.15.39:0/425269298 wait complete. 2024-09-13T11:16:34.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 Processor -- start 2024-09-13T11:16:34.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- start start 2024-09-13T11:16:34.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c069140 0x7fbf8c0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbf8c071fc0 0x7fbf8c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf8c074130 0x7fbf8c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c150ea0 con 0x7fbf8c069140 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf8c150d20 con 0x7fbf8c074130 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf91ace640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fbf8c151020 con 0x7fbf8c071fc0 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8affd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbf8c071fc0 0x7fbf8c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c069140 0x7fbf8c0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8affd640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbf8c071fc0 0x7fbf8c1464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57406/0 (socket says 172.21.15.39:57406) 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8affd640 1 -- 172.21.15.39:0/861814538 learned_addr learned my addr 172.21.15.39:0/861814538 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.761+0000 7fbf8b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c069140 0x7fbf8c0af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35996/0 (socket says 172.21.15.39:35996) 2024-09-13T11:16:34.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8bfff640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf8c074130 0x7fbf8c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8affd640 1 -- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf8c074130 msgr2=0x7fbf8c146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8affd640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf8c074130 0x7fbf8c146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8affd640 1 -- 172.21.15.39:0/861814538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c069140 msgr2=0x7fbf8c0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8affd640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c069140 0x7fbf8c0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8affd640 1 -- 172.21.15.39:0/861814538 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf8c0b0760 con 0x7fbf8c071fc0 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8b7fe640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbf8c069140 0x7fbf8c0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8affd640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbf8c071fc0 0x7fbf8c1464f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf800ad040 tx=0x7fbf8001ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf800bf410 con 0x7fbf8c071fc0 2024-09-13T11:16:34.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf800bf5d0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8c1427a0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf800bf9c0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf8c13a690 con 0x7fbf8c071fc0 2024-09-13T11:16:34.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf8c0729b0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fbf800bd020 con 0x7fbf8c071fc0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fbf78072100 0x7fbf780745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7fbf8012d260 con 0x7fbf8c071fc0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fbf780792c0 0x7fbf7807b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf800c7ec0 con 0x7fbf780792c0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbf8012d6f0 con 0x7fbf8c071fc0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8b7fe640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fbf78072100 0x7fbf780745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.765+0000 7fbf8bfff640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fbf780792c0 0x7fbf7807b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.769+0000 7fbf8b7fe640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fbf78072100 0x7fbf780745c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009f50 tx=0x7fbf7c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.769+0000 7fbf8bfff640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fbf780792c0 0x7fbf7807b6e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.769+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== osd.5 v2:172.21.15.102:6824/498174754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf800c7ec0 con 0x7fbf780792c0 2024-09-13T11:16:34.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 --> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf8c144e60 con 0x7fbf780792c0 2024-09-13T11:16:34.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf73fff640 1 -- 172.21.15.39:0/861814538 <== osd.5 v2:172.21.15.102:6824/498174754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf8c144e60 con 0x7fbf780792c0 2024-09-13T11:16:34.794 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:34.794 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:34.794 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fbf780792c0 msgr2=0x7fbf7807b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6824/498174754,v1:172.21.15.102:6825/498174754] conn(0x7fbf780792c0 0x7fbf7807b6e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fbf78072100 msgr2=0x7fbf780745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fbf78072100 0x7fbf780745c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009f50 tx=0x7fbf7c009190 comp rx=0 tx=0).stop 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbf8c071fc0 msgr2=0x7fbf8c1464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 --2- 172.21.15.39:0/861814538 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fbf8c071fc0 0x7fbf8c1464f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf800ad040 tx=0x7fbf8001ac10 comp rx=0 tx=0).stop 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf8bfff640 1 -- 172.21.15.39:0/861814538 reap_dead start 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 shutdown_connections 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 >> 172.21.15.39:0/861814538 conn(0x7fbf8c06c940 msgr2=0x7fbf8c14dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 shutdown_connections 2024-09-13T11:16:34.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.789+0000 7fbf91ace640 1 -- 172.21.15.39:0/861814538 wait complete. 2024-09-13T11:16:34.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T11:16:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b87d4640 1 Processor -- start 2024-09-13T11:16:34.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b87d4640 1 -- start start 2024-09-13T11:16:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b87d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b0070060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b87d4640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b0143c00 con 0x7fe9b0142dc0 2024-09-13T11:16:34.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b87d4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b0144c70 con 0x7fe9b01440b0 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b87d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b01438f0 con 0x7fe9b006fc80 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b6570640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b0070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b6570640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b0070060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57414/0 (socket says 172.21.15.39:57414) 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b6570640 1 -- 172.21.15.39:0/3757485895 learned_addr learned my addr 172.21.15.39:0/3757485895 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b6570640 1 -- 172.21.15.39:0/3757485895 >> v1:172.21.15.102:6789/0 conn(0x7fe9b01440b0 legacy=0x7fe9b0144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b6570640 1 -- 172.21.15.39:0/3757485895 >> v1:172.21.15.39:6789/0 conn(0x7fe9b0142dc0 legacy=0x7fe9b01431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b556e640 1 -- 172.21.15.39:0/3757485895 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343985233 0 0) 0x7fe9b0143c00 con 0x7fe9b0142dc0 2024-09-13T11:16:34.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.941+0000 7fe9b6570640 1 -- 172.21.15.39:0/3757485895 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b00708c0 con 0x7fe9b006fc80 2024-09-13T11:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b6570640 1 --2- 172.21.15.39:0/3757485895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b0070060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0098a0 tx=0x7fe9ac01c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60beac2a89392f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b556e640 1 -- 172.21.15.39:0/3757485895 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0b2070 con 0x7fe9b006fc80 2024-09-13T11:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b556e640 1 -- 172.21.15.39:0/3757485895 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0ad640 con 0x7fe9b006fc80 2024-09-13T11:16:34.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b556e640 1 -- 172.21.15.39:0/3757485895 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0ada10 con 0x7fe9b006fc80 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- 172.21.15.39:0/3757485895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 msgr2=0x7fe9b0070060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/3757485895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b0070060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0098a0 tx=0x7fe9ac01c500 comp rx=0 tx=0).stop 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- 172.21.15.39:0/3757485895 shutdown_connections 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/3757485895 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b0070060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- 172.21.15.39:0/3757485895 >> 172.21.15.39:0/3757485895 conn(0x7fe9b00b9b80 msgr2=0x7fe9b00b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- 172.21.15.39:0/3757485895 shutdown_connections 2024-09-13T11:16:34.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- 172.21.15.39:0/3757485895 wait complete. 2024-09-13T11:16:34.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 Processor -- start 2024-09-13T11:16:34.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- start start 2024-09-13T11:16:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b01df760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9b0142dc0 0x7fe9b01378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b01440b0 0x7fe9b0137e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0151dd0 con 0x7fe9b0142dc0 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b0071fc0 con 0x7fe9b01440b0 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.945+0000 7fe9b87d4640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b0151f50 con 0x7fe9b006fc80 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b01df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b01df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57428/0 (socket says 172.21.15.39:57428) 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 -- 172.21.15.39:0/1768575505 learned_addr learned my addr 172.21.15.39:0/1768575505 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b5d6f640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9b0142dc0 0x7fe9b01378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 -- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b01440b0 msgr2=0x7fe9b0137e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6d71640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b01440b0 0x7fe9b0137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b01440b0 0x7fe9b0137e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 -- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9b0142dc0 msgr2=0x7fe9b01378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9b0142dc0 0x7fe9b01378c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 -- 172.21.15.39:0/1768575505 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b0143440 con 0x7fe9b006fc80 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6d71640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b01440b0 0x7fe9b0137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b6570640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b01df760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac01a190 tx=0x7fe9ac019300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0bd070 con 0x7fe9b006fc80 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0b5660 con 0x7fe9b006fc80 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b013a250 con 0x7fe9b006fc80 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0b2040 con 0x7fe9b006fc80 2024-09-13T11:16:34.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b0142590 con 0x7fe9b006fc80 2024-09-13T11:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b0070060 con 0x7fe9b006fc80 2024-09-13T11:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fe9ac0b5a50 con 0x7fe9b006fc80 2024-09-13T11:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9a6ffd640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe994072100 0x7fe9940745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7fe9ac12c570 con 0x7fe9b006fc80 2024-09-13T11:16:34.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.949+0000 7fe9b5d6f640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe994072100 0x7fe9940745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:34.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.953+0000 7fe9b5d6f640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe994072100 0x7fe9940745c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00b8280 tx=0x7fe9a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:34.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:34.953+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe9b013a250 con 0x7fe9b006fc80 2024-09-13T11:16:35.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.153+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe9b00b7fd0 con 0x7fe994072100 2024-09-13T11:16:35.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.153+0000 7fe9a6ffd640 1 -- 172.21.15.39:0/1768575505 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9b00b7fd0 con 0x7fe994072100 2024-09-13T11:16:35.157 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T11:16:35.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.153+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe994072100 msgr2=0x7fe9940745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.153+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe994072100 0x7fe9940745c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00b8280 tx=0x7fe9a0009040 comp rx=0 tx=0).stop 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.153+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 msgr2=0x7fe9b01df760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.153+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b01df760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac01a190 tx=0x7fe9ac019300 comp rx=0 tx=0).stop 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 shutdown_connections 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fe994072100 0x7fe9940745c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b01440b0 0x7fe9b0137e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe9b0142dc0 0x7fe9b01378c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 --2- 172.21.15.39:0/1768575505 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fe9b006fc80 0x7fe9b01df760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 >> 172.21.15.39:0/1768575505 conn(0x7fe9b00b9b80 msgr2=0x7fe9b00b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 shutdown_connections 2024-09-13T11:16:35.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.157+0000 7fe9b87d4640 1 -- 172.21.15.39:0/1768575505 wait complete. 2024-09-13T11:16:35.176 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T11:16:35.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 Processor -- start 2024-09-13T11:16:35.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 -- start start 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0f3c0b7290 0x7f0f3c0aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f3c141c20 0x7f0f3c142060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c144fc0 0x7f0f3c145430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3c0ab300 con 0x7f0f3c0b7290 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0f3c0b7670 con 0x7f0f3c141c20 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f439e1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c141760 con 0x7f0f3c144fc0 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.293+0000 7f0f4177d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0f3c0b7290 0x7f0f3c0aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0f3c0b7290 0x7f0f3c0aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36010/0 (socket says 172.21.15.39:36010) 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 -- 172.21.15.39:0/3253707773 learned_addr learned my addr 172.21.15.39:0/3253707773 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f41f7e640 1 --2- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c144fc0 0x7f0f3c145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f40f7c640 1 --2- 172.21.15.39:0/3253707773 >> v2:172.21.15.102:3300/0 conn(0x7f0f3c141c20 0x7f0f3c142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 -- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c144fc0 msgr2=0x7f0f3c145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 --2- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c144fc0 0x7f0f3c145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 -- 172.21.15.39:0/3253707773 >> v2:172.21.15.102:3300/0 conn(0x7f0f3c141c20 msgr2=0x7f0f3c142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:35.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 --2- 172.21.15.39:0/3253707773 >> v2:172.21.15.102:3300/0 conn(0x7f0f3c141c20 0x7f0f3c142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 -- 172.21.15.39:0/3253707773 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c073cf0 con 0x7f0f3c0b7290 2024-09-13T11:16:35.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f40f7c640 1 --2- 172.21.15.39:0/3253707773 >> v2:172.21.15.102:3300/0 conn(0x7f0f3c141c20 0x7f0f3c142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T11:16:35.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f4177d640 1 --2- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c0b7290 0x7f0f3c0aabb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c073550 tx=0x7f0f3801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a79b5ff4f61105 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f33fff640 1 -- 172.21.15.39:0/3253707773 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380a57c0 con 0x7f0f3c0b7290 2024-09-13T11:16:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f33fff640 1 -- 172.21.15.39:0/3253707773 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f380a5960 con 0x7f0f3c0b7290 2024-09-13T11:16:35.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f33fff640 1 -- 172.21.15.39:0/3253707773 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f380a5d30 con 0x7f0f3c0b7290 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 -- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c0b7290 msgr2=0x7f0f3c0aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 --2- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c0b7290 0x7f0f3c0aabb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c073550 tx=0x7f0f3801c8e0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 -- 172.21.15.39:0/3253707773 shutdown_connections 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 --2- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c144fc0 0x7f0f3c145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 --2- 172.21.15.39:0/3253707773 >> v2:172.21.15.102:3300/0 conn(0x7f0f3c141c20 0x7f0f3c142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 --2- 172.21.15.39:0/3253707773 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c0b7290 0x7f0f3c0aabb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 -- 172.21.15.39:0/3253707773 >> 172.21.15.39:0/3253707773 conn(0x7f0f3c06e1a0 msgr2=0x7f0f3c0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 -- 172.21.15.39:0/3253707773 shutdown_connections 2024-09-13T11:16:35.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.297+0000 7f0f439e1640 1 -- 172.21.15.39:0/3253707773 wait complete. 2024-09-13T11:16:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 Processor -- start 2024-09-13T11:16:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- start start 2024-09-13T11:16:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f3c0b7290 0x7f0f3c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c141c20 0x7f0f3c0716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c144fc0 0x7f0f3c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c06d520 con 0x7f0f3c144fc0 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c06d3a0 con 0x7f0f3c0b7290 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3c06d6a0 con 0x7f0f3c141c20 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c141c20 0x7f0f3c0716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f41f7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c144fc0 0x7f0f3c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f41f7e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c144fc0 0x7f0f3c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36020/0 (socket says 172.21.15.39:36020) 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c141c20 0x7f0f3c0716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57444/0 (socket says 172.21.15.39:57444) 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 -- 172.21.15.39:0/2365037607 learned_addr learned my addr 172.21.15.39:0/2365037607 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f4177d640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f3c0b7290 0x7f0f3c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 -- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f3c0b7290 msgr2=0x7f0f3c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f3c0b7290 0x7f0f3c0b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 -- 172.21.15.39:0/2365037607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c144fc0 msgr2=0x7f0f3c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f3c144fc0 0x7f0f3c071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 -- 172.21.15.39:0/2365037607 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c13ae10 con 0x7f0f3c141c20 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f40f7c640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c141c20 0x7f0f3c0716f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c7f0 tx=0x7f0f2c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c015070 con 0x7f0f3c141c20 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c007a30 con 0x7f0f3c141c20 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c007e00 con 0x7f0f3c141c20 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c13d970 con 0x7f0f3c141c20 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c140420 con 0x7f0f3c141c20 2024-09-13T11:16:35.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f3c142060 con 0x7f0f3c141c20 2024-09-13T11:16:35.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.301+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f0f2c018070 con 0x7f0f3c141c20 2024-09-13T11:16:35.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f31ffb640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0f20072100 0x7f0f200745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f0f2c092db0 con 0x7f0f3c141c20 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f31ffb640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f0f200792c0 0x7f0f2007b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 --> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f2007bd90 con 0x7f0f200792c0 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f2c093240 con 0x7f0f3c141c20 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f4177d640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0f20072100 0x7f0f200745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f41f7e640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f0f200792c0 0x7f0f2007b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f4177d640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0f20072100 0x7f0f200745c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f380ae000 tx=0x7f0f380a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f41f7e640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f0f200792c0 0x7f0f2007b6e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.305+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== osd.6 v2:172.21.15.102:6808/2547475669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f2007bd90 con 0x7f0f200792c0 2024-09-13T11:16:35.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 --> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0f3c0699b0 con 0x7f0f200792c0 2024-09-13T11:16:35.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f31ffb640 1 -- 172.21.15.39:0/2365037607 <== osd.6 v2:172.21.15.102:6808/2547475669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0f3c0699b0 con 0x7f0f200792c0 2024-09-13T11:16:35.325 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:35.325 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:35.325 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f0f200792c0 msgr2=0x7f0f2007b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6808/2547475669,v1:172.21.15.102:6809/2547475669] conn(0x7f0f200792c0 0x7f0f2007b6e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0f20072100 msgr2=0x7f0f200745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0f20072100 0x7f0f200745c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0f380ae000 tx=0x7f0f380a7070 comp rx=0 tx=0).stop 2024-09-13T11:16:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c141c20 msgr2=0x7f0f3c0716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 --2- 172.21.15.39:0/2365037607 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0f3c141c20 0x7f0f3c0716f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c7f0 tx=0x7f0f2c00ccb0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f41f7e640 1 -- 172.21.15.39:0/2365037607 reap_dead start 2024-09-13T11:16:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 shutdown_connections 2024-09-13T11:16:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 >> 172.21.15.39:0/2365037607 conn(0x7f0f3c06e1a0 msgr2=0x7f0f3c0b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 shutdown_connections 2024-09-13T11:16:35.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.321+0000 7f0f439e1640 1 -- 172.21.15.39:0/2365037607 wait complete. 2024-09-13T11:16:35.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T11:16:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e40b1a640 1 Processor -- start 2024-09-13T11:16:35.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e40b1a640 1 -- start start 2024-09-13T11:16:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e40b1a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7e3c137d10 0x7f7e3c138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e40b1a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3c0b2db0 con 0x7f7e3c0b29d0 2024-09-13T11:16:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e40b1a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3c0ac320 con 0x7f7e3c1418c0 2024-09-13T11:16:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e40b1a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7e3c0ac600 con 0x7f7e3c137d10 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3a59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7e3c0b29d0 0x7f7e3c145170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50186/0 (socket says 172.21.15.39:50186) 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3a59c640 1 -- 172.21.15.39:0/3747138105 learned_addr learned my addr 172.21.15.39:0/3747138105 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200060791 0 0) 0x7f7e2c001120 con 0x7f7e3c0b29d0 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e28003530 con 0x7f7e3c0b29d0 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e33fff640 1 --2- 172.21.15.39:0/3747138105 >> v2:172.21.15.102:3300/0 conn(0x7f7e3c137d10 0x7f7e3c138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 368984888 0 0) 0x7f7e28003530 con 0x7f7e3c0b29d0 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 >> v2:172.21.15.102:3300/0 conn(0x7f7e3c137d10 msgr2=0x7f7e3c138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 --2- 172.21.15.39:0/3747138105 >> v2:172.21.15.102:3300/0 conn(0x7f7e3c137d10 0x7f7e3c138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 >> v1:172.21.15.102:6789/0 conn(0x7f7e3c1418c0 legacy=0x7f7e3c141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c145a00 con 0x7f7e3c0b29d0 2024-09-13T11:16:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f7e2c0018d0 con 0x7f7e3c0b29d0 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 >> v1:172.21.15.39:6789/0 conn(0x7f7e3c0b29d0 legacy=0x7f7e3c145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e28003a60 0x7f7e28003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e28004810 0x7f7e28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c0ac600 con 0x7f7e28004810 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2800c260 con 0x7f7e28003a60 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2800c460 con 0x7f7e280053d0 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3ad9d640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e33fff640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e28004810 0x7f7e28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3a59c640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e28003a60 0x7f7e28003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3ad9d640 1 -- 172.21.15.39:0/3747138105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e28003a60 msgr2=0x7f7e28003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3ad9d640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e28003a60 0x7f7e28003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3ad9d640 1 -- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e28004810 msgr2=0x7f7e28004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3ad9d640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e28004810 0x7f7e28004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e3ad9d640 1 -- 172.21.15.39:0/3747138105 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e28003530 con 0x7f7e280053d0 2024-09-13T11:16:35.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.449+0000 7f7e33fff640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e28004810 0x7f7e28004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e3ad9d640 1 -- 172.21.15.39:0/3747138105 reap_dead start 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e3ad9d640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e2800b9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001e90 tx=0x7f7e3401c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5978fa3245018c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400b600 con 0x7f7e280053d0 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e34003980 con 0x7f7e280053d0 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e39d9b640 1 -- 172.21.15.39:0/3747138105 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34001ae0 con 0x7f7e280053d0 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 msgr2=0x7f7e2800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e2800b9d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001e90 tx=0x7f7e3401c750 comp rx=0 tx=0).stop 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- 172.21.15.39:0/3747138105 shutdown_connections 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/3747138105 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e2800b9d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- 172.21.15.39:0/3747138105 >> 172.21.15.39:0/3747138105 conn(0x7f7e3c0b5dd0 msgr2=0x7f7e3c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- 172.21.15.39:0/3747138105 shutdown_connections 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- 172.21.15.39:0/3747138105 wait complete. 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 Processor -- start 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- start start 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e3c1dce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 0x7f7e3c142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c1430d0 0x7f7e3c12d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c138480 con 0x7f7e3c13ac80 2024-09-13T11:16:35.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7e3c138300 con 0x7f7e3c1430d0 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e40b1a640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f7e3c141cd0 con 0x7f7e280053d0 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e3a59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e3c1dce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e33fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 0x7f7e3c142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e33fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 0x7f7e3c142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36038/0 (socket says 172.21.15.39:36038) 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e33fff640 1 -- 172.21.15.39:0/301899648 learned_addr learned my addr 172.21.15.39:0/301899648 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.453+0000 7f7e3ad9d640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c1430d0 0x7f7e3c12d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e3a59c640 1 -- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c1430d0 msgr2=0x7f7e3c12d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e3a59c640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c1430d0 0x7f7e3c12d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e3a59c640 1 -- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 msgr2=0x7f7e3c142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e3a59c640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 0x7f7e3c142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e3a59c640 1 -- 172.21.15.39:0/301899648 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3c140e70 con 0x7f7e280053d0 2024-09-13T11:16:35.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e33fff640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 0x7f7e3c142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e3a59c640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e3c1dce80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c001060 tx=0x7f7e2c00ea00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c012650 con 0x7f7e280053d0 2024-09-13T11:16:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c018070 con 0x7f7e280053d0 2024-09-13T11:16:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3c13b720 con 0x7f7e280053d0 2024-09-13T11:16:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c012a30 con 0x7f7e280053d0 2024-09-13T11:16:35.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e3c143550 con 0x7f7e280053d0 2024-09-13T11:16:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e3c142020 con 0x7f7e280053d0 2024-09-13T11:16:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f7e2c012bd0 con 0x7f7e280053d0 2024-09-13T11:16:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e32ffd640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7e1c072100 0x7f7e1c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f7e2c0924d0 con 0x7f7e280053d0 2024-09-13T11:16:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e33fff640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7e1c072100 0x7f7e1c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.457+0000 7f7e33fff640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7e1c072100 0x7f7e1c0745c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c137230 tx=0x7f7e24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.465+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7e3c0b2db0 con 0x7f7e280053d0 2024-09-13T11:16:35.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.673+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f7e3c135ce0 con 0x7f7e1c072100 2024-09-13T11:16:35.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.673+0000 7f7e32ffd640 1 -- 172.21.15.39:0/301899648 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7e3c135ce0 con 0x7f7e1c072100 2024-09-13T11:16:35.678 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7e1c072100 msgr2=0x7f7e1c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7e1c072100 0x7f7e1c0745c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c137230 tx=0x7f7e24008040 comp rx=0 tx=0).stop 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 msgr2=0x7f7e3c1dce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e3c1dce80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c001060 tx=0x7f7e2c00ea00 comp rx=0 tx=0).stop 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 shutdown_connections 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f7e1c072100 0x7f7e1c0745c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e3c1430d0 0x7f7e3c12d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3c13ac80 0x7f7e3c142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 --2- 172.21.15.39:0/301899648 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f7e280053d0 0x7f7e3c1dce80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 >> 172.21.15.39:0/301899648 conn(0x7f7e3c0b5dd0 msgr2=0x7f7e3c144e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 shutdown_connections 2024-09-13T11:16:35.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.677+0000 7f7e40b1a640 1 -- 172.21.15.39:0/301899648 wait complete. 2024-09-13T11:16:35.704 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T11:16:35.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T11:16:35.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f0711de6640 1 Processor -- start 2024-09-13T11:16:35.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f0711de6640 1 -- start start 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f0711de6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 0x7f070c140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f0711de6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c141350 con 0x7f070c147150 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f0711de6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c147530 con 0x7f070c147bd0 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f0711de6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f070c0ae970 con 0x7f070c1409c0 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f070bfff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 0x7f070c140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f070bfff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 0x7f070c140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57472/0 (socket says 172.21.15.39:57472) 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f070bfff640 1 -- 172.21.15.39:0/3745987671 learned_addr learned my addr 172.21.15.39:0/3745987671 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f070bfff640 1 -- 172.21.15.39:0/3745987671 >> v1:172.21.15.102:6789/0 conn(0x7f070c147bd0 legacy=0x7f070c0727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f070bfff640 1 -- 172.21.15.39:0/3745987671 >> v1:172.21.15.39:6789/0 conn(0x7f070c147150 legacy=0x7f070c06f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.853+0000 7f070bfff640 1 -- 172.21.15.39:0/3745987671 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c0722d0 con 0x7f070c1409c0 2024-09-13T11:16:35.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f070bfff640 1 --2- 172.21.15.39:0/3745987671 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 0x7f070c140e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0704009e80 tx=0x7f070401c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10cecf902fff0284 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f070affd640 1 -- 172.21.15.39:0/3745987671 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040a5660 con 0x7f070c1409c0 2024-09-13T11:16:35.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f070affd640 1 -- 172.21.15.39:0/3745987671 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07040a5800 con 0x7f070c1409c0 2024-09-13T11:16:35.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f070affd640 1 -- 172.21.15.39:0/3745987671 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040a5bd0 con 0x7f070c1409c0 2024-09-13T11:16:35.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- 172.21.15.39:0/3745987671 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 msgr2=0x7f070c140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 --2- 172.21.15.39:0/3745987671 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 0x7f070c140e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0704009e80 tx=0x7f070401c9a0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- 172.21.15.39:0/3745987671 shutdown_connections 2024-09-13T11:16:35.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 --2- 172.21.15.39:0/3745987671 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c1409c0 0x7f070c140e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- 172.21.15.39:0/3745987671 >> 172.21.15.39:0/3745987671 conn(0x7f070c0b7d30 msgr2=0x7f070c0b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- 172.21.15.39:0/3745987671 shutdown_connections 2024-09-13T11:16:35.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- 172.21.15.39:0/3745987671 wait complete. 2024-09-13T11:16:35.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 Processor -- start 2024-09-13T11:16:35.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- start start 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1409c0 0x7f070c137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c147150 0x7f070c13d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f070c147bd0 0x7f070c1399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f070c151e40 con 0x7f070c1409c0 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f070c151cc0 con 0x7f070c147bd0 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0711de6640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f070c151fc0 con 0x7f070c147150 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0703fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c147150 0x7f070c13d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0703fff640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c147150 0x7f070c13d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57474/0 (socket says 172.21.15.39:57474) 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f0703fff640 1 -- 172.21.15.39:0/1183145794 learned_addr learned my addr 172.21.15.39:0/1183145794 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:35.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.857+0000 7f070b7fe640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1409c0 0x7f070c137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f070bfff640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f070c147bd0 0x7f070c1399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0703fff640 1 -- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f070c147bd0 msgr2=0x7f070c1399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0703fff640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f070c147bd0 0x7f070c1399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0703fff640 1 -- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1409c0 msgr2=0x7f070c137720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0703fff640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1409c0 0x7f070c137720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0703fff640 1 -- 172.21.15.39:0/1183145794 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c138240 con 0x7f070c147150 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f070b7fe640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f070c1409c0 0x7f070c137720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0703fff640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c147150 0x7f070c13d870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c3c0 tx=0x7f06fc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc017070 con 0x7f070c147150 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc0052d0 con 0x7f070c147150 2024-09-13T11:16:35.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0054c0 con 0x7f070c147150 2024-09-13T11:16:35.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c139590 con 0x7f070c147150 2024-09-13T11:16:35.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c139f00 con 0x7f070c147150 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f070c140e10 con 0x7f070c147150 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f06fc01a070 con 0x7f070c147150 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f06f0072100 0x7f06f00745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f06fc091c20 con 0x7f070c147150 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f06f00792c0 0x7f06f007b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 --> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06f007bd90 con 0x7f06f00792c0 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06fc0962a0 con 0x7f070c147150 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.861+0000 7f070b7fe640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f06f0072100 0x7f06f00745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.865+0000 7f070bfff640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f06f00792c0 0x7f06f007b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:35.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.865+0000 7f070bfff640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f06f00792c0 0x7f06f007b6e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.865+0000 7f070b7fe640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f06f0072100 0x7f06f00745c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06f4007fd0 tx=0x7f06f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:35.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.865+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== osd.7 v2:172.21.15.102:6800/3217028379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06f007bd90 con 0x7f06f00792c0 2024-09-13T11:16:35.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.881+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 --> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f070c13a460 con 0x7f06f00792c0 2024-09-13T11:16:35.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0708ff9640 1 -- 172.21.15.39:0/1183145794 <== osd.7 v2:172.21.15.102:6800/3217028379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f070c13a460 con 0x7f06f00792c0 2024-09-13T11:16:35.888 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-09-13T11:16:35.889 INFO:teuthology.orchestra.run.smithi039.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T11:16:35.889 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-09-13T11:16:35.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f06f00792c0 msgr2=0x7f06f007b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6800/3217028379,v1:172.21.15.102:6801/3217028379] conn(0x7f06f00792c0 0x7f06f007b6e0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f06f0072100 msgr2=0x7f06f00745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f06f0072100 0x7f06f00745c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f06f4007fd0 tx=0x7f06f4009040 comp rx=0 tx=0).stop 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c147150 msgr2=0x7f070c13d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 --2- 172.21.15.39:0/1183145794 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f070c147150 0x7f070c13d870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c3c0 tx=0x7f06fc00c880 comp rx=0 tx=0).stop 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f070bfff640 1 -- 172.21.15.39:0/1183145794 reap_dead start 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 shutdown_connections 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 >> 172.21.15.39:0/1183145794 conn(0x7f070c0b7d30 msgr2=0x7f070c070310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 shutdown_connections 2024-09-13T11:16:35.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:35.885+0000 7f0711de6640 1 -- 172.21.15.39:0/1183145794 wait complete. 2024-09-13T11:16:35.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T11:16:36.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 Processor -- start 2024-09-13T11:16:36.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 -- start start 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 0x7f0a280b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0a28138150 0x7f0a28145360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a280b7570 con 0x7f0a28137d30 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0a280b1980 con 0x7f0a28138150 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2ca14640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f0a28142720 con 0x7f0a280b7190 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 0x7f0a280b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 0x7f0a280b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57482/0 (socket says 172.21.15.39:57482) 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 -- 172.21.15.39:0/2329604143 learned_addr learned my addr 172.21.15.39:0/2329604143 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:36.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a26d9d640 1 --2- 172.21.15.39:0/2329604143 >> v2:172.21.15.102:3300/0 conn(0x7f0a28138150 0x7f0a28145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 -- 172.21.15.39:0/2329604143 >> v2:172.21.15.102:3300/0 conn(0x7f0a28138150 msgr2=0x7f0a28145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:36.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 --2- 172.21.15.39:0/2329604143 >> v2:172.21.15.102:3300/0 conn(0x7f0a28138150 0x7f0a28145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 -- 172.21.15.39:0/2329604143 >> v1:172.21.15.102:6789/0 conn(0x7f0a28137d30 legacy=0x7f0a28144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:36.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.029+0000 7f0a2659c640 1 -- 172.21.15.39:0/2329604143 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a280b2190 con 0x7f0a280b7190 2024-09-13T11:16:36.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2659c640 1 --2- 172.21.15.39:0/2329604143 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 0x7f0a280b1220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009870 tx=0x7f0a1801eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e72079fc7095f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:36.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2559a640 1 -- 172.21.15.39:0/2329604143 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180b5070 con 0x7f0a280b7190 2024-09-13T11:16:36.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2559a640 1 -- 172.21.15.39:0/2329604143 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a180a87d0 con 0x7f0a280b7190 2024-09-13T11:16:36.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2559a640 1 -- 172.21.15.39:0/2329604143 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180a8ba0 con 0x7f0a280b7190 2024-09-13T11:16:36.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2329604143 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 msgr2=0x7f0a280b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2329604143 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 0x7f0a280b1220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009870 tx=0x7f0a1801eb50 comp rx=0 tx=0).stop 2024-09-13T11:16:36.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2329604143 shutdown_connections 2024-09-13T11:16:36.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2329604143 >> v2:172.21.15.102:3300/0 conn(0x7f0a28138150 0x7f0a28145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2329604143 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a280b7190 0x7f0a280b1220 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2329604143 >> 172.21.15.39:0/2329604143 conn(0x7f0a2806e110 msgr2=0x7f0a280b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:36.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2329604143 shutdown_connections 2024-09-13T11:16:36.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2329604143 wait complete. 2024-09-13T11:16:36.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 Processor -- start 2024-09-13T11:16:36.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- start start 2024-09-13T11:16:36.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a280b7190 0x7f0a2814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 0x7f0a28071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a28138150 0x7f0a28072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2814c160 con 0x7f0a28138150 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2814bfe0 con 0x7f0a280b7190 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2ca14640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2814c2e0 con 0x7f0a28137d30 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 0x7f0a28071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 0x7f0a28071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57486/0 (socket says 172.21.15.39:57486) 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 -- 172.21.15.39:0/2939187201 learned_addr learned my addr 172.21.15.39:0/2939187201 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a26d9d640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a28138150 0x7f0a28072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a2659c640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a280b7190 0x7f0a2814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 -- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a280b7190 msgr2=0x7f0a2814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a280b7190 0x7f0a2814a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 -- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a28138150 msgr2=0x7f0a28072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a28138150 0x7f0a28072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 -- 172.21.15.39:0/2939187201 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a28139eb0 con 0x7f0a28137d30 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a25d9b640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 0x7f0a28071dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c410 tx=0x7f0a1c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c011790 con 0x7f0a28137d30 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1c017070 con 0x7f0a28137d30 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.033+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c011bb0 con 0x7f0a28137d30 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a28138730 con 0x7f0a28137d30 2024-09-13T11:16:36.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a28138e20 con 0x7f0a28137d30 2024-09-13T11:16:36.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a280b1220 con 0x7f0a28137d30 2024-09-13T11:16:36.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f0a1c01c460 con 0x7f0a28137d30 2024-09-13T11:16:36.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a16ffd640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0a08072100 0x7f0a080745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f0a1c0924c0 con 0x7f0a28137d30 2024-09-13T11:16:36.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a2659c640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0a08072100 0x7f0a080745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.037+0000 7f0a2659c640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0a08072100 0x7f0a080745c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a180b2000 tx=0x7f0a18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:36.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.041+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0a1c021020 con 0x7f0a28137d30 2024-09-13T11:16:36.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.221+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0a28138900 con 0x7f0a08072100 2024-09-13T11:16:36.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a16ffd640 1 -- 172.21.15.39:0/2939187201 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0a28138900 con 0x7f0a08072100 2024-09-13T11:16:36.228 INFO:teuthology.orchestra.run.smithi039.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T11:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0a08072100 msgr2=0x7f0a080745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0a08072100 0x7f0a080745c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a180b2000 tx=0x7f0a18008040 comp rx=0 tx=0).stop 2024-09-13T11:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 msgr2=0x7f0a28071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 0x7f0a28071dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c410 tx=0x7f0a1c00c8d0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 shutdown_connections 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f0a08072100 0x7f0a080745c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a28138150 0x7f0a28072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f0a28137d30 0x7f0a28071dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 --2- 172.21.15.39:0/2939187201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a280b7190 0x7f0a2814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 >> 172.21.15.39:0/2939187201 conn(0x7f0a2806e110 msgr2=0x7f0a280b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 shutdown_connections 2024-09-13T11:16:36.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.225+0000 7f0a2ca14640 1 -- 172.21.15.39:0/2939187201 wait complete. 2024-09-13T11:16:36.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:16:36.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 Processor -- start 2024-09-13T11:16:36.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 -- start start 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c072990 0x7fc69c139650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc69c073d90 0x7fc69c139b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 0x7fc69c140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c0aac60 con 0x7fc69c072d70 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c13fd70 con 0x7fc69c073d90 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a456b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c13a0d0 con 0x7fc69c072990 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2b08640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 0x7fc69c140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c072990 0x7fc69c139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2b08640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 0x7fc69c140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36048/0 (socket says 172.21.15.39:36048) 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2b08640 1 -- 172.21.15.39:0/2578382953 learned_addr learned my addr 172.21.15.39:0/2578382953 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a1b06640 1 --2- 172.21.15.39:0/2578382953 >> v2:172.21.15.102:3300/0 conn(0x7fc69c073d90 0x7fc69c139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 -- 172.21.15.39:0/2578382953 >> v2:172.21.15.102:3300/0 conn(0x7fc69c073d90 msgr2=0x7fc69c139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 --2- 172.21.15.39:0/2578382953 >> v2:172.21.15.102:3300/0 conn(0x7fc69c073d90 0x7fc69c139b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 -- 172.21.15.39:0/2578382953 >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 msgr2=0x7fc69c140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 --2- 172.21.15.39:0/2578382953 >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 0x7fc69c140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 -- 172.21.15.39:0/2578382953 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c070790 con 0x7fc69c072990 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2b08640 1 --2- 172.21.15.39:0/2578382953 >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 0x7fc69c140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:36.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.369+0000 7fc6a2307640 1 --2- 172.21.15.39:0/2578382953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c072990 0x7fc69c139650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc69c06e2e0 tx=0x7fc69801ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa71fa13981335d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1305640 1 -- 172.21.15.39:0/2578382953 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980b4070 con 0x7fc69c072990 2024-09-13T11:16:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1305640 1 -- 172.21.15.39:0/2578382953 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6980a7990 con 0x7fc69c072990 2024-09-13T11:16:36.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1305640 1 -- 172.21.15.39:0/2578382953 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6980a7d60 con 0x7fc69c072990 2024-09-13T11:16:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/2578382953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c072990 msgr2=0x7fc69c139650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- 172.21.15.39:0/2578382953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c072990 0x7fc69c139650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc69c06e2e0 tx=0x7fc69801ea70 comp rx=0 tx=0).stop 2024-09-13T11:16:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/2578382953 shutdown_connections 2024-09-13T11:16:36.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- 172.21.15.39:0/2578382953 >> v2:172.21.15.39:3300/0 conn(0x7fc69c072d70 0x7fc69c140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- 172.21.15.39:0/2578382953 >> v2:172.21.15.102:3300/0 conn(0x7fc69c073d90 0x7fc69c139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- 172.21.15.39:0/2578382953 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c072990 0x7fc69c139650 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/2578382953 >> 172.21.15.39:0/2578382953 conn(0x7fc69c0b5dd0 msgr2=0x7fc69c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:36.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/2578382953 shutdown_connections 2024-09-13T11:16:36.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/2578382953 wait complete. 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 Processor -- start 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- start start 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69c072990 0x7fc69c13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 0x7fc69c1386b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 0x7fc69c138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c143680 con 0x7fc69c072d70 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c143500 con 0x7fc69c072990 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c143800 con 0x7fc69c073d90 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 0x7fc69c1386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a2b08640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 0x7fc69c138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 0x7fc69c1386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36062/0 (socket says 172.21.15.39:36062) 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a2b08640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 0x7fc69c138bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:57508/0 (socket says 172.21.15.39:57508) 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 -- 172.21.15.39:0/3553030935 learned_addr learned my addr 172.21.15.39:0/3553030935 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a2307640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69c072990 0x7fc69c13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 -- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 msgr2=0x7fc69c138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 0x7fc69c138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 -- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69c072990 msgr2=0x7fc69c13c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69c072990 0x7fc69c13c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 -- 172.21.15.39:0/3553030935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c0ae5b0 con 0x7fc69c072d70 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a2b08640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 0x7fc69c138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a1b06640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 0x7fc69c1386b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00d5d0 tx=0x7fc68c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0125f0 con 0x7fc69c072d70 2024-09-13T11:16:36.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68c019070 con 0x7fc69c072d70 2024-09-13T11:16:36.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c0ae890 con 0x7fc69c072d70 2024-09-13T11:16:36.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0129b0 con 0x7fc69c072d70 2024-09-13T11:16:36.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.373+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c0b0e90 con 0x7fc69c072d70 2024-09-13T11:16:36.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.377+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c140290 con 0x7fc69c072d70 2024-09-13T11:16:36.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.377+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7fc68c012b50 con 0x7fc69c072d70 2024-09-13T11:16:36.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.377+0000 7fc692ffd640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fc680072100 0x7fc6800745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:36.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.377+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7fc68c092ba0 con 0x7fc69c072d70 2024-09-13T11:16:36.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.377+0000 7fc6a2307640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fc680072100 0x7fc6800745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:36.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.377+0000 7fc6a2307640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fc680072100 0x7fc6800745c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6980b1000 tx=0x7fc6980a9070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:36.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.381+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc68c05def0 con 0x7fc69c072d70 2024-09-13T11:16:36.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.553+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc69c14a100 con 0x7fc680072100 2024-09-13T11:16:36.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc692ffd640 1 -- 172.21.15.39:0/3553030935 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117524 (secure 0 0 0) 0x7fc6980dab30 con 0x7fc680072100 2024-09-13T11:16:36.566 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:16:36.567 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:16:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fc680072100 msgr2=0x7fc6800745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fc680072100 0x7fc6800745c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6980b1000 tx=0x7fc6980a9070 comp rx=0 tx=0).stop 2024-09-13T11:16:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 msgr2=0x7fc69c1386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 0x7fc69c1386b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00d5d0 tx=0x7fc68c00da90 comp rx=0 tx=0).stop 2024-09-13T11:16:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 shutdown_connections 2024-09-13T11:16:36.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7fc680072100 0x7fc6800745c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7fc69c073d90 0x7fc69c138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc69c072d70 0x7fc69c1386b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 --2- 172.21.15.39:0/3553030935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69c072990 0x7fc69c13c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 >> 172.21.15.39:0/3553030935 conn(0x7fc69c0b5dd0 msgr2=0x7fc69c149510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 shutdown_connections 2024-09-13T11:16:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:36.561+0000 7fc6a456b640 1 -- 172.21.15.39:0/3553030935 wait complete. 2024-09-13T11:16:36.589 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-09-13T11:16:36.067277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3579339563,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":0,"num_read":2633,"num_read_kb":2638,"num_write":162875,"num_write_kb":5650383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164642,"ondisk_log_size":164642,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8207960,"kb_used_data":6992792,"kb_used_omap":12,"kb_used_meta":1215027,"kb_avail":746766760,"statfs":{"total":773094113280,"available":764689162240,"internally_reserved":0,"allocated":7160619008,"data_stored":7159200326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1244188209},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8720,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":66,"num_read_kb":71,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003301"},"pg_stats":[{"pgid":"3.1f","version":"23'3476","reported_seq":3495,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.153702+0000","last_change":"2024-09-13T11:12:05.719358+0000","last_active":"2024-09-13T11:16:29.153702+0000","last_peered":"2024-09-13T11:16:29.153702+0000","last_clean":"2024-09-13T11:16:29.153702+0000","last_became_active":"2024-09-13T11:12:05.719081+0000","last_became_peered":"2024-09-13T11:12:05.719081+0000","last_unstale":"2024-09-13T11:16:29.153702+0000","last_undegraded":"2024-09-13T11:16:29.153702+0000","last_fullsized":"2024-09-13T11:16:29.153702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3476,"log_dups_size":0,"ondisk_log_size":3476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:56.858667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90834768,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":159322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"25'5689","reported_seq":5716,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.234272+0000","last_change":"2024-09-13T11:12:05.710129+0000","last_active":"2024-09-13T11:16:29.234272+0000","last_peered":"2024-09-13T11:16:29.234272+0000","last_clean":"2024-09-13T11:16:29.234272+0000","last_became_active":"2024-09-13T11:12:05.709855+0000","last_became_peered":"2024-09-13T11:12:05.709855+0000","last_unstale":"2024-09-13T11:16:29.234272+0000","last_undegraded":"2024-09-13T11:16:29.234272+0000","last_fullsized":"2024-09-13T11:16:29.234272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5689,"log_dups_size":0,"ondisk_log_size":5689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:54.761992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117572096,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":28,"num_read_kb":84,"num_write":5683,"num_write_kb":165192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4915","reported_seq":4941,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197798+0000","last_change":"2024-09-13T11:12:05.730996+0000","last_active":"2024-09-13T11:16:29.197798+0000","last_peered":"2024-09-13T11:16:29.197798+0000","last_clean":"2024-09-13T11:16:29.197798+0000","last_became_active":"2024-09-13T11:12:05.730262+0000","last_became_peered":"2024-09-13T11:12:05.730262+0000","last_unstale":"2024-09-13T11:16:29.197798+0000","last_undegraded":"2024-09-13T11:16:29.197798+0000","last_fullsized":"2024-09-13T11:16:29.197798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4915,"log_dups_size":0,"ondisk_log_size":4915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:17.111335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":4903,"num_write_kb":132100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"23'4411","reported_seq":4430,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196379+0000","last_change":"2024-09-13T11:12:05.728308+0000","last_active":"2024-09-13T11:16:29.196379+0000","last_peered":"2024-09-13T11:16:29.196379+0000","last_clean":"2024-09-13T11:16:29.196379+0000","last_became_active":"2024-09-13T11:12:05.727615+0000","last_became_peered":"2024-09-13T11:12:05.727615+0000","last_unstale":"2024-09-13T11:16:29.196379+0000","last_undegraded":"2024-09-13T11:16:29.196379+0000","last_fullsized":"2024-09-13T11:16:29.196379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:15:49.921089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117506568,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4416,"num_write_kb":182807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2878","reported_seq":2896,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.237338+0000","last_change":"2024-09-13T11:12:05.726002+0000","last_active":"2024-09-13T11:16:29.237338+0000","last_peered":"2024-09-13T11:16:29.237338+0000","last_clean":"2024-09-13T11:16:29.237338+0000","last_became_active":"2024-09-13T11:12:05.725707+0000","last_became_peered":"2024-09-13T11:12:05.725707+0000","last_unstale":"2024-09-13T11:16:29.237338+0000","last_undegraded":"2024-09-13T11:16:29.237338+0000","last_fullsized":"2024-09-13T11:16:29.237338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2878,"log_dups_size":0,"ondisk_log_size":2878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:18:45.458853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2825,"num_write_kb":115717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'4755","reported_seq":4877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151751+0000","last_change":"2024-09-13T11:12:05.707268+0000","last_active":"2024-09-13T11:16:29.151751+0000","last_peered":"2024-09-13T11:16:29.151751+0000","last_clean":"2024-09-13T11:16:29.151751+0000","last_became_active":"2024-09-13T11:12:05.706491+0000","last_became_peered":"2024-09-13T11:12:05.706491+0000","last_unstale":"2024-09-13T11:16:29.151751+0000","last_undegraded":"2024-09-13T11:16:29.151751+0000","last_fullsized":"2024-09-13T11:16:29.151751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:36.756608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58983456,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":4748,"num_write_kb":132323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"25'5661","reported_seq":5683,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.233064+0000","last_change":"2024-09-13T11:12:05.705309+0000","last_active":"2024-09-13T11:16:29.233064+0000","last_peered":"2024-09-13T11:16:29.233064+0000","last_clean":"2024-09-13T11:16:29.233064+0000","last_became_active":"2024-09-13T11:12:05.704854+0000","last_became_peered":"2024-09-13T11:12:05.704854+0000","last_unstale":"2024-09-13T11:16:29.233064+0000","last_undegraded":"2024-09-13T11:16:29.233064+0000","last_fullsized":"2024-09-13T11:16:29.233064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5661,"log_dups_size":0,"ondisk_log_size":5661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:16.712542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":5619,"num_write_kb":211837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"24'9115","reported_seq":9133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.231382+0000","last_change":"2024-09-13T11:12:05.708931+0000","last_active":"2024-09-13T11:16:29.231382+0000","last_peered":"2024-09-13T11:16:29.231382+0000","last_clean":"2024-09-13T11:16:29.231382+0000","last_became_active":"2024-09-13T11:12:05.708741+0000","last_became_peered":"2024-09-13T11:12:05.708741+0000","last_unstale":"2024-09-13T11:16:29.231382+0000","last_undegraded":"2024-09-13T11:16:29.231382+0000","last_fullsized":"2024-09-13T11:16:29.231382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9115,"log_dups_size":0,"ondisk_log_size":9115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:21:41.221566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9109,"num_write_kb":263300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"24'6180","reported_seq":6204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.153830+0000","last_change":"2024-09-13T11:12:05.718373+0000","last_active":"2024-09-13T11:16:29.153830+0000","last_peered":"2024-09-13T11:16:29.153830+0000","last_clean":"2024-09-13T11:16:29.153830+0000","last_became_active":"2024-09-13T11:12:05.718074+0000","last_became_peered":"2024-09-13T11:12:05.718074+0000","last_unstale":"2024-09-13T11:16:29.153830+0000","last_undegraded":"2024-09-13T11:16:29.153830+0000","last_fullsized":"2024-09-13T11:16:29.153830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:42.722029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":6189,"num_write_kb":150954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'3312","reported_seq":3330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197817+0000","last_change":"2024-09-13T11:12:05.719775+0000","last_active":"2024-09-13T11:16:29.197817+0000","last_peered":"2024-09-13T11:16:29.197817+0000","last_clean":"2024-09-13T11:16:29.197817+0000","last_became_active":"2024-09-13T11:12:05.716472+0000","last_became_peered":"2024-09-13T11:12:05.716472+0000","last_unstale":"2024-09-13T11:16:29.197817+0000","last_undegraded":"2024-09-13T11:16:29.197817+0000","last_fullsized":"2024-09-13T11:16:29.197817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3312,"log_dups_size":0,"ondisk_log_size":3312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:12.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85395112,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3286,"num_write_kb":133748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"24'6541","reported_seq":6562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171301+0000","last_change":"2024-09-13T11:12:05.723073+0000","last_active":"2024-09-13T11:16:29.171301+0000","last_peered":"2024-09-13T11:16:29.171301+0000","last_clean":"2024-09-13T11:16:29.171301+0000","last_became_active":"2024-09-13T11:12:05.722294+0000","last_became_peered":"2024-09-13T11:12:05.722294+0000","last_unstale":"2024-09-13T11:16:29.171301+0000","last_undegraded":"2024-09-13T11:16:29.171301+0000","last_fullsized":"2024-09-13T11:16:29.171301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6541,"log_dups_size":0,"ondisk_log_size":6541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:16.657467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6545,"num_write_kb":158257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'6358","reported_seq":6376,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.246364+0000","last_change":"2024-09-13T11:12:05.714322+0000","last_active":"2024-09-13T11:16:29.246364+0000","last_peered":"2024-09-13T11:16:29.246364+0000","last_clean":"2024-09-13T11:16:29.246364+0000","last_became_active":"2024-09-13T11:12:05.713307+0000","last_became_peered":"2024-09-13T11:12:05.713307+0000","last_unstale":"2024-09-13T11:16:29.246364+0000","last_undegraded":"2024-09-13T11:16:29.246364+0000","last_fullsized":"2024-09-13T11:16:29.246364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6358,"log_dups_size":0,"ondisk_log_size":6358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:57.992974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":215299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.236747+0000","last_change":"2024-09-13T11:11:59.264383+0000","last_active":"2024-09-13T11:16:29.236747+0000","last_peered":"2024-09-13T11:16:29.236747+0000","last_clean":"2024-09-13T11:16:29.236747+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:16:29.236747+0000","last_undegraded":"2024-09-13T11:16:29.236747+0000","last_fullsized":"2024-09-13T11:16:29.236747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:48:19.549032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'6833","reported_seq":6887,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:33.085567+0000","last_change":"2024-09-13T11:16:33.085567+0000","last_active":"2024-09-13T11:16:33.085567+0000","last_peered":"2024-09-13T11:16:33.085567+0000","last_clean":"2024-09-13T11:16:33.085567+0000","last_became_active":"2024-09-13T11:12:05.707378+0000","last_became_peered":"2024-09-13T11:12:05.707378+0000","last_unstale":"2024-09-13T11:16:33.085567+0000","last_undegraded":"2024-09-13T11:16:33.085567+0000","last_fullsized":"2024-09-13T11:16:33.085567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6833","last_scrub_stamp":"2024-09-13T11:16:33.085505+0000","last_deep_scrub":"25'6833","last_deep_scrub_stamp":"2024-09-13T11:16:33.085505+0000","last_clean_scrub_stamp":"2024-09-13T11:16:33.085505+0000","objects_scrubbed":27,"log_size":6833,"log_dups_size":0,"ondisk_log_size":6833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:11.173529+0000","scrub_duration":279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":6821,"num_write_kb":193336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.220989+0000","last_change":"2024-09-13T11:11:59.170926+0000","last_active":"2024-09-13T11:16:29.220989+0000","last_peered":"2024-09-13T11:16:29.220989+0000","last_clean":"2024-09-13T11:16:29.220989+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:16:29.220989+0000","last_undegraded":"2024-09-13T11:16:29.220989+0000","last_fullsized":"2024-09-13T11:16:29.220989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:52:28.792477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4655","reported_seq":4684,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.247983+0000","last_change":"2024-09-13T11:12:05.711115+0000","last_active":"2024-09-13T11:16:29.247983+0000","last_peered":"2024-09-13T11:16:29.247983+0000","last_clean":"2024-09-13T11:16:29.247983+0000","last_became_active":"2024-09-13T11:12:05.710876+0000","last_became_peered":"2024-09-13T11:12:05.710876+0000","last_unstale":"2024-09-13T11:16:29.247983+0000","last_undegraded":"2024-09-13T11:16:29.247983+0000","last_fullsized":"2024-09-13T11:16:29.247983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4655,"log_dups_size":0,"ondisk_log_size":4655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:43.433333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107063120,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":4630,"num_write_kb":171206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.172123+0000","last_change":"2024-09-13T11:11:59.264364+0000","last_active":"2024-09-13T11:16:29.172123+0000","last_peered":"2024-09-13T11:16:29.172123+0000","last_clean":"2024-09-13T11:16:29.172123+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:16:29.172123+0000","last_undegraded":"2024-09-13T11:16:29.172123+0000","last_fullsized":"2024-09-13T11:16:29.172123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:46.598343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8136","reported_seq":8160,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.220365+0000","last_change":"2024-09-13T11:12:05.889138+0000","last_active":"2024-09-13T11:16:29.220365+0000","last_peered":"2024-09-13T11:16:29.220365+0000","last_clean":"2024-09-13T11:16:29.220365+0000","last_became_active":"2024-09-13T11:12:05.888409+0000","last_became_peered":"2024-09-13T11:12:05.888409+0000","last_unstale":"2024-09-13T11:16:29.220365+0000","last_undegraded":"2024-09-13T11:16:29.220365+0000","last_fullsized":"2024-09-13T11:16:29.220365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8136,"log_dups_size":0,"ondisk_log_size":8136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:52:16.890148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543104,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":8142,"num_write_kb":253572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:33.442208+0000","last_change":"2024-09-13T11:16:33.442208+0000","last_active":"2024-09-13T11:16:33.442208+0000","last_peered":"2024-09-13T11:16:33.442208+0000","last_clean":"2024-09-13T11:16:33.442208+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:16:33.442208+0000","last_undegraded":"2024-09-13T11:16:33.442208+0000","last_fullsized":"2024-09-13T11:16:33.442208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:33.442035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:33.442035+0000","last_clean_scrub_stamp":"2024-09-13T11:16:33.442035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:04.034045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'4755","reported_seq":4774,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.197667+0000","last_change":"2024-09-13T11:12:05.729028+0000","last_active":"2024-09-13T11:16:29.197667+0000","last_peered":"2024-09-13T11:16:29.197667+0000","last_clean":"2024-09-13T11:16:29.197667+0000","last_became_active":"2024-09-13T11:12:05.726919+0000","last_became_peered":"2024-09-13T11:12:05.726919+0000","last_unstale":"2024-09-13T11:16:29.197667+0000","last_undegraded":"2024-09-13T11:16:29.197667+0000","last_fullsized":"2024-09-13T11:16:29.197667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:14:42.310569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4753,"num_write_kb":177157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"23'6488","reported_seq":6831,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151891+0000","last_change":"2024-09-13T11:12:05.724178+0000","last_active":"2024-09-13T11:16:29.151891+0000","last_peered":"2024-09-13T11:16:29.151891+0000","last_clean":"2024-09-13T11:16:29.151891+0000","last_became_active":"2024-09-13T11:12:05.715353+0000","last_became_peered":"2024-09-13T11:12:05.715353+0000","last_unstale":"2024-09-13T11:16:29.151891+0000","last_undegraded":"2024-09-13T11:16:29.151891+0000","last_fullsized":"2024-09-13T11:16:29.151891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":6488,"log_dups_size":0,"ondisk_log_size":6488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:39:43.645877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1078,"num_read_kb":960,"num_write":6740,"num_write_kb":218838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":34,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196274+0000","last_change":"2024-09-13T11:11:59.177551+0000","last_active":"2024-09-13T11:16:29.196274+0000","last_peered":"2024-09-13T11:16:29.196274+0000","last_clean":"2024-09-13T11:16:29.196274+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:16:29.196274+0000","last_undegraded":"2024-09-13T11:16:29.196274+0000","last_fullsized":"2024-09-13T11:16:29.196274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:06.698959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"25'3585","reported_seq":3604,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.236756+0000","last_change":"2024-09-13T11:12:05.890104+0000","last_active":"2024-09-13T11:16:29.236756+0000","last_peered":"2024-09-13T11:16:29.236756+0000","last_clean":"2024-09-13T11:16:29.236756+0000","last_became_active":"2024-09-13T11:12:05.889331+0000","last_became_peered":"2024-09-13T11:12:05.889331+0000","last_unstale":"2024-09-13T11:16:29.236756+0000","last_undegraded":"2024-09-13T11:16:29.236756+0000","last_fullsized":"2024-09-13T11:16:29.236756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3585,"log_dups_size":0,"ondisk_log_size":3585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:00:36.750096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3535,"num_write_kb":168833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.151663+0000","last_change":"2024-09-13T11:11:59.262864+0000","last_active":"2024-09-13T11:16:29.151663+0000","last_peered":"2024-09-13T11:16:29.151663+0000","last_clean":"2024-09-13T11:16:29.151663+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:16:29.151663+0000","last_undegraded":"2024-09-13T11:16:29.151663+0000","last_fullsized":"2024-09-13T11:16:29.151663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:49.061602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"25'3818","reported_seq":3837,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.153513+0000","last_change":"2024-09-13T11:12:05.716843+0000","last_active":"2024-09-13T11:16:29.153513+0000","last_peered":"2024-09-13T11:16:29.153513+0000","last_clean":"2024-09-13T11:16:29.153513+0000","last_became_active":"2024-09-13T11:12:05.716555+0000","last_became_peered":"2024-09-13T11:12:05.716555+0000","last_unstale":"2024-09-13T11:16:29.153513+0000","last_undegraded":"2024-09-13T11:16:29.153513+0000","last_fullsized":"2024-09-13T11:16:29.153513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3818,"log_dups_size":0,"ondisk_log_size":3818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:33.343050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":161030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171199+0000","last_change":"2024-09-13T11:11:59.264363+0000","last_active":"2024-09-13T11:16:29.171199+0000","last_peered":"2024-09-13T11:16:29.171199+0000","last_clean":"2024-09-13T11:16:29.171199+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:16:29.171199+0000","last_undegraded":"2024-09-13T11:16:29.171199+0000","last_fullsized":"2024-09-13T11:16:29.171199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:03:02.989025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'5147","reported_seq":5185,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.232518+0000","last_change":"2024-09-13T11:12:05.717945+0000","last_active":"2024-09-13T11:16:29.232518+0000","last_peered":"2024-09-13T11:16:29.232518+0000","last_clean":"2024-09-13T11:16:29.232518+0000","last_became_active":"2024-09-13T11:12:05.717715+0000","last_became_peered":"2024-09-13T11:12:05.717715+0000","last_unstale":"2024-09-13T11:16:29.232518+0000","last_undegraded":"2024-09-13T11:16:29.232518+0000","last_fullsized":"2024-09-13T11:16:29.232518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5147,"log_dups_size":0,"ondisk_log_size":5147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:00:42.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":5176,"num_write_kb":147263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.196089+0000","last_change":"2024-09-13T11:11:59.175526+0000","last_active":"2024-09-13T11:16:29.196089+0000","last_peered":"2024-09-13T11:16:29.196089+0000","last_clean":"2024-09-13T11:16:29.196089+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:16:29.196089+0000","last_undegraded":"2024-09-13T11:16:29.196089+0000","last_fullsized":"2024-09-13T11:16:29.196089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:56.092292+0000","last_clean_scrub_stamp":"2024-09-13T11:11:56.092292+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:00:13.643417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171211+0000","last_change":"2024-09-13T11:11:49.099967+0000","last_active":"2024-09-13T11:16:29.171211+0000","last_peered":"2024-09-13T11:16:29.171211+0000","last_clean":"2024-09-13T11:16:29.171211+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:16:29.171211+0000","last_undegraded":"2024-09-13T11:16:29.171211+0000","last_fullsized":"2024-09-13T11:16:29.171211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:11:48.073845+0000","last_clean_scrub_stamp":"2024-09-13T11:11:48.073845+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:02.753349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"25'2975","reported_seq":3003,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.243899+0000","last_change":"2024-09-13T11:12:05.700433+0000","last_active":"2024-09-13T11:16:29.243899+0000","last_peered":"2024-09-13T11:16:29.243899+0000","last_clean":"2024-09-13T11:16:29.243899+0000","last_became_active":"2024-09-13T11:12:05.700153+0000","last_became_peered":"2024-09-13T11:12:05.700153+0000","last_unstale":"2024-09-13T11:16:29.243899+0000","last_undegraded":"2024-09-13T11:16:29.243899+0000","last_fullsized":"2024-09-13T11:16:29.243899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2975,"log_dups_size":0,"ondisk_log_size":2975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:13.356022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104988672,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":2914,"num_write_kb":144131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'8255","reported_seq":8402,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.282078+0000","last_change":"2024-09-13T11:12:05.888680+0000","last_active":"2024-09-13T11:16:29.282078+0000","last_peered":"2024-09-13T11:16:29.282078+0000","last_clean":"2024-09-13T11:16:29.282078+0000","last_became_active":"2024-09-13T11:12:05.888170+0000","last_became_peered":"2024-09-13T11:12:05.888170+0000","last_unstale":"2024-09-13T11:16:29.282078+0000","last_undegraded":"2024-09-13T11:16:29.282078+0000","last_fullsized":"2024-09-13T11:16:29.282078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":8255,"log_dups_size":0,"ondisk_log_size":8255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:46:22.997764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114688000,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":443,"num_read_kb":398,"num_write":6304,"num_write_kb":189330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"25'5169","reported_seq":5191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.236599+0000","last_change":"2024-09-13T11:12:05.727588+0000","last_active":"2024-09-13T11:16:29.236599+0000","last_peered":"2024-09-13T11:16:29.236599+0000","last_clean":"2024-09-13T11:16:29.236599+0000","last_became_active":"2024-09-13T11:12:05.726759+0000","last_became_peered":"2024-09-13T11:12:05.726759+0000","last_unstale":"2024-09-13T11:16:29.236599+0000","last_undegraded":"2024-09-13T11:16:29.236599+0000","last_fullsized":"2024-09-13T11:16:29.236599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5169,"log_dups_size":0,"ondisk_log_size":5169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:55:38.027194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":5148,"num_write_kb":185606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"23'4264","reported_seq":4294,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.232681+0000","last_change":"2024-09-13T11:12:05.709828+0000","last_active":"2024-09-13T11:16:29.232681+0000","last_peered":"2024-09-13T11:16:29.232681+0000","last_clean":"2024-09-13T11:16:29.232681+0000","last_became_active":"2024-09-13T11:12:05.709368+0000","last_became_peered":"2024-09-13T11:12:05.709368+0000","last_unstale":"2024-09-13T11:16:29.232681+0000","last_undegraded":"2024-09-13T11:16:29.232681+0000","last_fullsized":"2024-09-13T11:16:29.232681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":0,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:48.129402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121635328,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":4285,"num_write_kb":189832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'4764","reported_seq":4789,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.230267+0000","last_change":"2024-09-13T11:12:05.719371+0000","last_active":"2024-09-13T11:16:29.230267+0000","last_peered":"2024-09-13T11:16:29.230267+0000","last_clean":"2024-09-13T11:16:29.230267+0000","last_became_active":"2024-09-13T11:12:05.716884+0000","last_became_peered":"2024-09-13T11:12:05.716884+0000","last_unstale":"2024-09-13T11:16:29.230267+0000","last_undegraded":"2024-09-13T11:16:29.230267+0000","last_fullsized":"2024-09-13T11:16:29.230267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4764,"log_dups_size":0,"ondisk_log_size":4764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:14:34.250313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130220552,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":27,"num_read_kb":83,"num_write":4732,"num_write_kb":234695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3101","reported_seq":3135,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171732+0000","last_change":"2024-09-13T11:12:05.731406+0000","last_active":"2024-09-13T11:16:29.171732+0000","last_peered":"2024-09-13T11:16:29.171732+0000","last_clean":"2024-09-13T11:16:29.171732+0000","last_became_active":"2024-09-13T11:12:05.730642+0000","last_became_peered":"2024-09-13T11:12:05.730642+0000","last_unstale":"2024-09-13T11:16:29.171732+0000","last_undegraded":"2024-09-13T11:16:29.171732+0000","last_fullsized":"2024-09-13T11:16:29.171732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3101,"log_dups_size":0,"ondisk_log_size":3101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:34.115785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98697744,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":61,"num_read_kb":48,"num_write":3111,"num_write_kb":136971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'4815","reported_seq":4937,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.256381+0000","last_change":"2024-09-13T11:12:05.731761+0000","last_active":"2024-09-13T11:16:29.256381+0000","last_peered":"2024-09-13T11:16:29.256381+0000","last_clean":"2024-09-13T11:16:29.256381+0000","last_became_active":"2024-09-13T11:12:05.731054+0000","last_became_peered":"2024-09-13T11:12:05.731054+0000","last_unstale":"2024-09-13T11:16:29.256381+0000","last_undegraded":"2024-09-13T11:16:29.256381+0000","last_fullsized":"2024-09-13T11:16:29.256381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4815,"log_dups_size":0,"ondisk_log_size":4815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:45.840805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120389632,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":345,"num_read_kb":457,"num_write":5202,"num_write_kb":163956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'5304","reported_seq":5322,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.246195+0000","last_change":"2024-09-13T11:12:05.723811+0000","last_active":"2024-09-13T11:16:29.246195+0000","last_peered":"2024-09-13T11:16:29.246195+0000","last_clean":"2024-09-13T11:16:29.246195+0000","last_became_active":"2024-09-13T11:12:05.722874+0000","last_became_peered":"2024-09-13T11:12:05.722874+0000","last_unstale":"2024-09-13T11:16:29.246195+0000","last_undegraded":"2024-09-13T11:16:29.246195+0000","last_fullsized":"2024-09-13T11:16:29.246195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":5304,"log_dups_size":0,"ondisk_log_size":5304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:43.959449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148860928,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":228833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"25'2495","reported_seq":2515,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.245912+0000","last_change":"2024-09-13T11:12:05.713322+0000","last_active":"2024-09-13T11:16:29.245912+0000","last_peered":"2024-09-13T11:16:29.245912+0000","last_clean":"2024-09-13T11:16:29.245912+0000","last_became_active":"2024-09-13T11:12:05.712482+0000","last_became_peered":"2024-09-13T11:12:05.712482+0000","last_unstale":"2024-09-13T11:16:29.245912+0000","last_undegraded":"2024-09-13T11:16:29.245912+0000","last_fullsized":"2024-09-13T11:16:29.245912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":2495,"log_dups_size":0,"ondisk_log_size":2495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:50.799467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497984,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2455,"num_write_kb":115332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"23'4070","reported_seq":4090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171469+0000","last_change":"2024-09-13T11:12:05.729681+0000","last_active":"2024-09-13T11:16:29.171469+0000","last_peered":"2024-09-13T11:16:29.171469+0000","last_clean":"2024-09-13T11:16:29.171469+0000","last_became_active":"2024-09-13T11:12:05.728964+0000","last_became_peered":"2024-09-13T11:12:05.728964+0000","last_unstale":"2024-09-13T11:16:29.171469+0000","last_undegraded":"2024-09-13T11:16:29.171469+0000","last_fullsized":"2024-09-13T11:16:29.171469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:54.843915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99232096,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":4074,"num_write_kb":180077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'3597","reported_seq":3620,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.235860+0000","last_change":"2024-09-13T11:12:05.720869+0000","last_active":"2024-09-13T11:16:29.235860+0000","last_peered":"2024-09-13T11:16:29.235860+0000","last_clean":"2024-09-13T11:16:29.235860+0000","last_became_active":"2024-09-13T11:12:05.720600+0000","last_became_peered":"2024-09-13T11:12:05.720600+0000","last_unstale":"2024-09-13T11:16:29.235860+0000","last_undegraded":"2024-09-13T11:16:29.235860+0000","last_fullsized":"2024-09-13T11:16:29.235860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":3597,"log_dups_size":0,"ondisk_log_size":3597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:58:51.802715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":152845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'9050","reported_seq":9082,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:29.171396+0000","last_change":"2024-09-13T11:12:05.731290+0000","last_active":"2024-09-13T11:16:29.171396+0000","last_peered":"2024-09-13T11:16:29.171396+0000","last_clean":"2024-09-13T11:16:29.171396+0000","last_became_active":"2024-09-13T11:12:05.729859+0000","last_became_peered":"2024-09-13T11:12:05.729859+0000","last_unstale":"2024-09-13T11:16:29.171396+0000","last_undegraded":"2024-09-13T11:16:29.171396+0000","last_fullsized":"2024-09-13T11:16:29.171396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:12:05.230582+0000","last_clean_scrub_stamp":"2024-09-13T11:12:05.230582+0000","objects_scrubbed":0,"log_size":9050,"log_dups_size":0,"ondisk_log_size":9050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:53:12.549090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":9057,"num_write_kb":215054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3578749176,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2567,"num_read_kb":2583,"num_write":162772,"num_write_kb":5648753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7157325824,"data_stored":7157236208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164567,"ondisk_log_size":164567,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542204,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286328,"kb_used_data":1102504,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93085512,"statfs":{"total":96636764160,"available":95319564288,"internally_reserved":0,"allocated":1128964096,"data_stored":1128778774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":188217803},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542204,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077864,"kb_used_data":916248,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":93293976,"statfs":{"total":96636764160,"available":95533031424,"internally_reserved":0,"allocated":938237952,"data_stored":938054313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542204,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1685516,"kb_used_data":1437884,"kb_used_omap":1,"kb_used_meta":247614,"kb_avail":92686324,"statfs":{"total":96636764160,"available":94910795776,"internally_reserved":0,"allocated":1472393216,"data_stored":1472208918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253557189},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429584,"kb_used_data":349888,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":93942256,"statfs":{"total":96636764160,"available":96196870144,"internally_reserved":0,"allocated":358285312,"data_stored":358121086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765340,"kb_used_data":635660,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":93606500,"statfs":{"total":96636764160,"available":95853056000,"internally_reserved":0,"allocated":650915840,"data_stored":650740401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361048,"kb_used_data":303496,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94010792,"statfs":{"total":96636764160,"available":96267051008,"internally_reserved":0,"allocated":310779904,"data_stored":310608510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1312904,"kb_used_data":1137400,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":93058936,"statfs":{"total":96636764160,"available":95292350464,"internally_reserved":0,"allocated":1164697600,"data_stored":1164520406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":179698119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1289376,"kb_used_data":1109712,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":93082464,"statfs":{"total":96636764160,"available":95316443136,"internally_reserved":0,"allocated":1136345088,"data_stored":1136167918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1135489024,"data_stored":1135479632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":650649600,"data_stored":650642464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":358023168,"data_stored":358023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1164435456,"data_stored":1164422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1472131072,"data_stored":1472111000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":937971712,"data_stored":937956376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":310517760,"data_stored":310510592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1128108032,"data_stored":1128090488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:16:36.594 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.594 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.594 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.595 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.596 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T11:11:56.092292+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T11:11:48.073845+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=11, tm_sec=48, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.597 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.598 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T11:12:05.230582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=12, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=11, tm_min=16, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T11:16:36.599 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T11:16:56.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T11:16:56.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 Processor -- start 2024-09-13T11:16:56.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 -- start start 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768143a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6768143fd0 0x7f676814ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67680ab220 con 0x7f67680b2a30 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f67680b2e10 con 0x7f6768143fd0 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676fee8640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f6768073560 con 0x7f6768072f90 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676d483640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:56.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676dc84640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f67680b2a30 0x7f6768136a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47578/0 (socket says 172.21.15.39:47578) 2024-09-13T11:16:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676dc84640 1 -- 172.21.15.39:0/2433423711 learned_addr learned my addr 172.21.15.39:0/2433423711 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676e485640 1 --2- 172.21.15.39:0/2433423711 >> v2:172.21.15.102:3300/0 conn(0x7f6768143fd0 0x7f676814ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676d483640 1 -- 172.21.15.39:0/2433423711 >> v2:172.21.15.102:3300/0 conn(0x7f6768143fd0 msgr2=0x7f676814ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676d483640 1 --2- 172.21.15.39:0/2433423711 >> v2:172.21.15.102:3300/0 conn(0x7f6768143fd0 0x7f676814ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676d483640 1 -- 172.21.15.39:0/2433423711 >> v1:172.21.15.39:6789/0 conn(0x7f67680b2a30 legacy=0x7f6768136a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:56.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.729+0000 7f676d483640 1 -- 172.21.15.39:0/2433423711 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67680ab500 con 0x7f6768072f90 2024-09-13T11:16:56.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676d483640 1 --2- 172.21.15.39:0/2433423711 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768143a90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f675c0097c0 tx=0x7f675c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ec6b31e9355cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:56.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676cc82640 1 -- 172.21.15.39:0/2433423711 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0aa600 con 0x7f6768072f90 2024-09-13T11:16:56.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676cc82640 1 -- 172.21.15.39:0/2433423711 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c0af070 con 0x7f6768072f90 2024-09-13T11:16:56.736 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676cc82640 1 -- 172.21.15.39:0/2433423711 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0aa9c0 con 0x7f6768072f90 2024-09-13T11:16:56.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- 172.21.15.39:0/2433423711 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 msgr2=0x7f6768143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:56.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 --2- 172.21.15.39:0/2433423711 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768143a90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f675c0097c0 tx=0x7f675c01c480 comp rx=0 tx=0).stop 2024-09-13T11:16:56.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- 172.21.15.39:0/2433423711 shutdown_connections 2024-09-13T11:16:56.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 --2- 172.21.15.39:0/2433423711 >> v2:172.21.15.102:3300/0 conn(0x7f6768143fd0 0x7f676814ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 --2- 172.21.15.39:0/2433423711 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768143a90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- 172.21.15.39:0/2433423711 >> 172.21.15.39:0/2433423711 conn(0x7f67680b5dd0 msgr2=0x7f67680b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:56.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- 172.21.15.39:0/2433423711 shutdown_connections 2024-09-13T11:16:56.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- 172.21.15.39:0/2433423711 wait complete. 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 Processor -- start 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- start start 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67680b2a30 0x7f67681395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6768143fd0 0x7f6768139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6768144560 con 0x7f67680b2a30 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f67681443e0 con 0x7f6768143fd0 2024-09-13T11:16:56.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676fee8640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f676814db80 con 0x7f6768072f90 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676d483640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67680b2a30 0x7f67681395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33082/0 (socket says 172.21.15.39:33082) 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 -- 172.21.15.39:0/1403501882 learned_addr learned my addr 172.21.15.39:0/1403501882 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676e485640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6768143fd0 0x7f6768139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 -- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6768143fd0 msgr2=0x7f6768139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6768143fd0 0x7f6768139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 -- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67680b2a30 msgr2=0x7f67681395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67680b2a30 0x7f67681395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 -- 172.21.15.39:0/1403501882 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6768139050 con 0x7f6768072f90 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676d483640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67680b2a30 0x7f67681395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:56.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f676dc84640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768142c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f676400c480 tx=0x7f676400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764017070 con 0x7f6768072f90 2024-09-13T11:16:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6764005d10 con 0x7f6768072f90 2024-09-13T11:16:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.733+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67640072b0 con 0x7f6768072f90 2024-09-13T11:16:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676813a050 con 0x7f6768072f90 2024-09-13T11:16:56.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6768137530 con 0x7f6768072f90 2024-09-13T11:16:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6768143a90 con 0x7f6768072f90 2024-09-13T11:16:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f676401a070 con 0x7f6768072f90 2024-09-13T11:16:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f675a7fc640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f674c072100 0x7f674c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f6764091c00 con 0x7f6768072f90 2024-09-13T11:16:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f676d483640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f674c072100 0x7f674c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:56.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.737+0000 7f676d483640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f674c072100 0x7f674c0745c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f675c0ae000 tx=0x7f675c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:56.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.741+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6764098080 con 0x7f6768072f90 2024-09-13T11:16:56.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.909+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 --> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f676813a5e0 con 0x7f674c072100 2024-09-13T11:16:56.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.913+0000 7f675a7fc640 1 -- 172.21.15.39:0/1403501882 <== mgr.4101 v2:172.21.15.102:6832/259014220 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117775 (secure 0 0 0) 0x7f676813a5e0 con 0x7f674c072100 2024-09-13T11:16:56.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-09-13T11:16:56.922 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f674c072100 msgr2=0x7f674c0745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f674c072100 0x7f674c0745c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f675c0ae000 tx=0x7f675c0a7000 comp rx=0 tx=0).stop 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 msgr2=0x7f6768142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768142c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f676400c480 tx=0x7f676400c940 comp rx=0 tx=0).stop 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 shutdown_connections 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f674c072100 0x7f674c0745c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6768143fd0 0x7f6768139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f67680b2a30 0x7f67681395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 --2- 172.21.15.39:0/1403501882 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f6768072f90 0x7f6768142c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:56.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 >> 172.21.15.39:0/1403501882 conn(0x7f67680b5dd0 msgr2=0x7f6768135eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:56.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 shutdown_connections 2024-09-13T11:16:56.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:56.917+0000 7f676fee8640 1 -- 172.21.15.39:0/1403501882 wait complete. 2024-09-13T11:16:56.939 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-09-13T11:16:56.074119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3579339563,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":0,"num_read":2633,"num_read_kb":2638,"num_write":162875,"num_write_kb":5650383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165498,"ondisk_log_size":165498,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8234264,"kb_used_data":6992792,"kb_used_omap":12,"kb_used_meta":1241331,"kb_avail":746740456,"statfs":{"total":773094113280,"available":764662226944,"internally_reserved":0,"allocated":7160619008,"data_stored":7159200326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":1271123505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003820"},"pg_stats":[{"pgid":"3.1f","version":"25'3498","reported_seq":3525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:38.106413+0000","last_change":"2024-09-13T11:16:38.106413+0000","last_active":"2024-09-13T11:16:38.106413+0000","last_peered":"2024-09-13T11:16:38.106413+0000","last_clean":"2024-09-13T11:16:38.106413+0000","last_became_active":"2024-09-13T11:12:05.719081+0000","last_became_peered":"2024-09-13T11:12:05.719081+0000","last_unstale":"2024-09-13T11:16:38.106413+0000","last_undegraded":"2024-09-13T11:16:38.106413+0000","last_fullsized":"2024-09-13T11:16:38.106413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3498","last_scrub_stamp":"2024-09-13T11:16:38.106242+0000","last_deep_scrub":"25'3498","last_deep_scrub_stamp":"2024-09-13T11:16:38.106242+0000","last_clean_scrub_stamp":"2024-09-13T11:16:38.106242+0000","objects_scrubbed":22,"log_size":3498,"log_dups_size":0,"ondisk_log_size":3498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:29:37.857224+0000","scrub_duration":315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90834768,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3471,"num_write_kb":159322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"25'5719","reported_seq":5755,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:39.110003+0000","last_change":"2024-09-13T11:16:39.110003+0000","last_active":"2024-09-13T11:16:39.110003+0000","last_peered":"2024-09-13T11:16:39.110003+0000","last_clean":"2024-09-13T11:16:39.110003+0000","last_became_active":"2024-09-13T11:12:05.709855+0000","last_became_peered":"2024-09-13T11:12:05.709855+0000","last_unstale":"2024-09-13T11:16:39.110003+0000","last_undegraded":"2024-09-13T11:16:39.110003+0000","last_fullsized":"2024-09-13T11:16:39.110003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5719","last_scrub_stamp":"2024-09-13T11:16:39.109822+0000","last_deep_scrub":"25'5719","last_deep_scrub_stamp":"2024-09-13T11:16:39.109822+0000","last_clean_scrub_stamp":"2024-09-13T11:16:39.109822+0000","objects_scrubbed":30,"log_size":5719,"log_dups_size":0,"ondisk_log_size":5719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:19:03.985480+0000","scrub_duration":447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117572096,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":28,"num_read_kb":84,"num_write":5683,"num_write_kb":165192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"25'4936","reported_seq":4970,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:41.746504+0000","last_change":"2024-09-13T11:16:41.746504+0000","last_active":"2024-09-13T11:16:41.746504+0000","last_peered":"2024-09-13T11:16:41.746504+0000","last_clean":"2024-09-13T11:16:41.746504+0000","last_became_active":"2024-09-13T11:12:05.730262+0000","last_became_peered":"2024-09-13T11:12:05.730262+0000","last_unstale":"2024-09-13T11:16:41.746504+0000","last_undegraded":"2024-09-13T11:16:41.746504+0000","last_fullsized":"2024-09-13T11:16:41.746504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4936","last_scrub_stamp":"2024-09-13T11:16:41.746294+0000","last_deep_scrub":"25'4936","last_deep_scrub_stamp":"2024-09-13T11:16:41.746294+0000","last_clean_scrub_stamp":"2024-09-13T11:16:41.746294+0000","objects_scrubbed":21,"log_size":4936,"log_dups_size":0,"ondisk_log_size":4936,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:17.771208+0000","scrub_duration":327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":4903,"num_write_kb":132100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"25'4440","reported_seq":4468,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:39.831558+0000","last_change":"2024-09-13T11:16:39.831558+0000","last_active":"2024-09-13T11:16:39.831558+0000","last_peered":"2024-09-13T11:16:39.831558+0000","last_clean":"2024-09-13T11:16:39.831558+0000","last_became_active":"2024-09-13T11:12:05.727615+0000","last_became_peered":"2024-09-13T11:12:05.727615+0000","last_unstale":"2024-09-13T11:16:39.831558+0000","last_undegraded":"2024-09-13T11:16:39.831558+0000","last_fullsized":"2024-09-13T11:16:39.831558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4440","last_scrub_stamp":"2024-09-13T11:16:39.831427+0000","last_deep_scrub":"25'4440","last_deep_scrub_stamp":"2024-09-13T11:16:39.831427+0000","last_clean_scrub_stamp":"2024-09-13T11:16:39.831427+0000","objects_scrubbed":29,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:52:52.371495+0000","scrub_duration":407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117506568,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4416,"num_write_kb":182807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2904","reported_seq":2931,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:34.152591+0000","last_change":"2024-09-13T11:16:34.152591+0000","last_active":"2024-09-13T11:16:34.152591+0000","last_peered":"2024-09-13T11:16:34.152591+0000","last_clean":"2024-09-13T11:16:34.152591+0000","last_became_active":"2024-09-13T11:12:05.725707+0000","last_became_peered":"2024-09-13T11:12:05.725707+0000","last_unstale":"2024-09-13T11:16:34.152591+0000","last_undegraded":"2024-09-13T11:16:34.152591+0000","last_fullsized":"2024-09-13T11:16:34.152591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2904","last_scrub_stamp":"2024-09-13T11:16:34.152513+0000","last_deep_scrub":"25'2904","last_deep_scrub_stamp":"2024-09-13T11:16:34.152513+0000","last_clean_scrub_stamp":"2024-09-13T11:16:34.152513+0000","objects_scrubbed":26,"log_size":2904,"log_dups_size":0,"ondisk_log_size":2904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:05.149728+0000","scrub_duration":331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2825,"num_write_kb":115717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"25'4771","reported_seq":4901,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:38.180575+0000","last_change":"2024-09-13T11:16:38.180575+0000","last_active":"2024-09-13T11:16:38.180575+0000","last_peered":"2024-09-13T11:16:38.180575+0000","last_clean":"2024-09-13T11:16:38.180575+0000","last_became_active":"2024-09-13T11:12:05.706491+0000","last_became_peered":"2024-09-13T11:12:05.706491+0000","last_unstale":"2024-09-13T11:16:38.180575+0000","last_undegraded":"2024-09-13T11:16:38.180575+0000","last_fullsized":"2024-09-13T11:16:38.180575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4771","last_scrub_stamp":"2024-09-13T11:16:38.180411+0000","last_deep_scrub":"25'4771","last_deep_scrub_stamp":"2024-09-13T11:16:38.180411+0000","last_clean_scrub_stamp":"2024-09-13T11:16:38.180411+0000","objects_scrubbed":16,"log_size":4771,"log_dups_size":0,"ondisk_log_size":4771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:23:15.670295+0000","scrub_duration":215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58983456,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":4748,"num_write_kb":132323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"25'5693","reported_seq":5724,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.024043+0000","last_change":"2024-09-13T11:16:37.024043+0000","last_active":"2024-09-13T11:16:37.024043+0000","last_peered":"2024-09-13T11:16:37.024043+0000","last_clean":"2024-09-13T11:16:37.024043+0000","last_became_active":"2024-09-13T11:12:05.704854+0000","last_became_peered":"2024-09-13T11:12:05.704854+0000","last_unstale":"2024-09-13T11:16:37.024043+0000","last_undegraded":"2024-09-13T11:16:37.024043+0000","last_fullsized":"2024-09-13T11:16:37.024043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5693","last_scrub_stamp":"2024-09-13T11:16:37.023907+0000","last_deep_scrub":"25'5693","last_deep_scrub_stamp":"2024-09-13T11:16:37.023907+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.023907+0000","objects_scrubbed":32,"log_size":5693,"log_dups_size":0,"ondisk_log_size":5693,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:37.930669+0000","scrub_duration":471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":5619,"num_write_kb":211837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"25'9151","reported_seq":9178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:38.312246+0000","last_change":"2024-09-13T11:16:38.312246+0000","last_active":"2024-09-13T11:16:38.312246+0000","last_peered":"2024-09-13T11:16:38.312246+0000","last_clean":"2024-09-13T11:16:38.312246+0000","last_became_active":"2024-09-13T11:12:05.708741+0000","last_became_peered":"2024-09-13T11:12:05.708741+0000","last_unstale":"2024-09-13T11:16:38.312246+0000","last_undegraded":"2024-09-13T11:16:38.312246+0000","last_fullsized":"2024-09-13T11:16:38.312246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9151","last_scrub_stamp":"2024-09-13T11:16:38.312144+0000","last_deep_scrub":"25'9151","last_deep_scrub_stamp":"2024-09-13T11:16:38.312144+0000","last_clean_scrub_stamp":"2024-09-13T11:16:38.312144+0000","objects_scrubbed":36,"log_size":9151,"log_dups_size":0,"ondisk_log_size":9151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:32.164268+0000","scrub_duration":611,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9109,"num_write_kb":263300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"25'6209","reported_seq":6242,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.267270+0000","last_change":"2024-09-13T11:16:37.267270+0000","last_active":"2024-09-13T11:16:37.267270+0000","last_peered":"2024-09-13T11:16:37.267270+0000","last_clean":"2024-09-13T11:16:37.267270+0000","last_became_active":"2024-09-13T11:12:05.718074+0000","last_became_peered":"2024-09-13T11:12:05.718074+0000","last_unstale":"2024-09-13T11:16:37.267270+0000","last_undegraded":"2024-09-13T11:16:37.267270+0000","last_fullsized":"2024-09-13T11:16:37.267270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6209","last_scrub_stamp":"2024-09-13T11:16:37.267117+0000","last_deep_scrub":"25'6209","last_deep_scrub_stamp":"2024-09-13T11:16:37.267117+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.267117+0000","objects_scrubbed":29,"log_size":6209,"log_dups_size":0,"ondisk_log_size":6209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:45.928922+0000","scrub_duration":447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":6189,"num_write_kb":150954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'3333","reported_seq":3359,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:40.760301+0000","last_change":"2024-09-13T11:16:40.760301+0000","last_active":"2024-09-13T11:16:40.760301+0000","last_peered":"2024-09-13T11:16:40.760301+0000","last_clean":"2024-09-13T11:16:40.760301+0000","last_became_active":"2024-09-13T11:12:05.716472+0000","last_became_peered":"2024-09-13T11:12:05.716472+0000","last_unstale":"2024-09-13T11:16:40.760301+0000","last_undegraded":"2024-09-13T11:16:40.760301+0000","last_fullsized":"2024-09-13T11:16:40.760301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3333","last_scrub_stamp":"2024-09-13T11:16:40.760061+0000","last_deep_scrub":"25'3333","last_deep_scrub_stamp":"2024-09-13T11:16:40.760061+0000","last_clean_scrub_stamp":"2024-09-13T11:16:40.760061+0000","objects_scrubbed":21,"log_size":3333,"log_dups_size":0,"ondisk_log_size":3333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:29:49.716593+0000","scrub_duration":307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85395112,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3286,"num_write_kb":133748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"25'6562","reported_seq":6591,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:44.899485+0000","last_change":"2024-09-13T11:16:44.899485+0000","last_active":"2024-09-13T11:16:44.899485+0000","last_peered":"2024-09-13T11:16:44.899485+0000","last_clean":"2024-09-13T11:16:44.899485+0000","last_became_active":"2024-09-13T11:12:05.722294+0000","last_became_peered":"2024-09-13T11:12:05.722294+0000","last_unstale":"2024-09-13T11:16:44.899485+0000","last_undegraded":"2024-09-13T11:16:44.899485+0000","last_fullsized":"2024-09-13T11:16:44.899485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6562","last_scrub_stamp":"2024-09-13T11:16:44.899260+0000","last_deep_scrub":"25'6562","last_deep_scrub_stamp":"2024-09-13T11:16:44.899260+0000","last_clean_scrub_stamp":"2024-09-13T11:16:44.899260+0000","objects_scrubbed":21,"log_size":6562,"log_dups_size":0,"ondisk_log_size":6562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:36.609631+0000","scrub_duration":347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6545,"num_write_kb":158257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"25'6393","reported_seq":6421,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:36.503895+0000","last_change":"2024-09-13T11:16:36.503782+0000","last_active":"2024-09-13T11:16:36.503895+0000","last_peered":"2024-09-13T11:16:36.503895+0000","last_clean":"2024-09-13T11:16:36.503895+0000","last_became_active":"2024-09-13T11:12:05.713307+0000","last_became_peered":"2024-09-13T11:12:05.713307+0000","last_unstale":"2024-09-13T11:16:36.503895+0000","last_undegraded":"2024-09-13T11:16:36.503895+0000","last_fullsized":"2024-09-13T11:16:36.503895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6393","last_scrub_stamp":"2024-09-13T11:16:36.503635+0000","last_deep_scrub":"25'6393","last_deep_scrub_stamp":"2024-09-13T11:16:36.503635+0000","last_clean_scrub_stamp":"2024-09-13T11:16:36.503635+0000","objects_scrubbed":35,"log_size":6393,"log_dups_size":0,"ondisk_log_size":6393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:23:18.261896+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145358848,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6304,"num_write_kb":215299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:36.269486+0000","last_change":"2024-09-13T11:16:36.269486+0000","last_active":"2024-09-13T11:16:36.269486+0000","last_peered":"2024-09-13T11:16:36.269486+0000","last_clean":"2024-09-13T11:16:36.269486+0000","last_became_active":"2024-09-13T11:11:57.146043+0000","last_became_peered":"2024-09-13T11:11:57.146043+0000","last_unstale":"2024-09-13T11:16:36.269486+0000","last_undegraded":"2024-09-13T11:16:36.269486+0000","last_fullsized":"2024-09-13T11:16:36.269486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:36.269320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:36.269320+0000","last_clean_scrub_stamp":"2024-09-13T11:16:36.269320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:49.317803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001096119,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'6833","reported_seq":6887,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:33.085567+0000","last_change":"2024-09-13T11:16:33.085567+0000","last_active":"2024-09-13T11:16:33.085567+0000","last_peered":"2024-09-13T11:16:33.085567+0000","last_clean":"2024-09-13T11:16:33.085567+0000","last_became_active":"2024-09-13T11:12:05.707378+0000","last_became_peered":"2024-09-13T11:12:05.707378+0000","last_unstale":"2024-09-13T11:16:33.085567+0000","last_undegraded":"2024-09-13T11:16:33.085567+0000","last_fullsized":"2024-09-13T11:16:33.085567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6833","last_scrub_stamp":"2024-09-13T11:16:33.085505+0000","last_deep_scrub":"25'6833","last_deep_scrub_stamp":"2024-09-13T11:16:33.085505+0000","last_clean_scrub_stamp":"2024-09-13T11:16:33.085505+0000","objects_scrubbed":27,"log_size":6833,"log_dups_size":0,"ondisk_log_size":6833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:11.173529+0000","scrub_duration":279,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":6821,"num_write_kb":193336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.534824+0000","last_change":"2024-09-13T11:16:37.534824+0000","last_active":"2024-09-13T11:16:37.534824+0000","last_peered":"2024-09-13T11:16:37.534824+0000","last_clean":"2024-09-13T11:16:37.534824+0000","last_became_active":"2024-09-13T11:11:57.144230+0000","last_became_peered":"2024-09-13T11:11:57.144230+0000","last_unstale":"2024-09-13T11:16:37.534824+0000","last_undegraded":"2024-09-13T11:16:37.534824+0000","last_fullsized":"2024-09-13T11:16:37.534824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:37.534580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:37.534580+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.534580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:47.574623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001117055,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4682","reported_seq":4720,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:35.094257+0000","last_change":"2024-09-13T11:16:35.094257+0000","last_active":"2024-09-13T11:16:35.094257+0000","last_peered":"2024-09-13T11:16:35.094257+0000","last_clean":"2024-09-13T11:16:35.094257+0000","last_became_active":"2024-09-13T11:12:05.710876+0000","last_became_peered":"2024-09-13T11:12:05.710876+0000","last_unstale":"2024-09-13T11:16:35.094257+0000","last_undegraded":"2024-09-13T11:16:35.094257+0000","last_fullsized":"2024-09-13T11:16:35.094257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4682","last_scrub_stamp":"2024-09-13T11:16:35.094179+0000","last_deep_scrub":"25'4682","last_deep_scrub_stamp":"2024-09-13T11:16:35.094179+0000","last_clean_scrub_stamp":"2024-09-13T11:16:35.094179+0000","objects_scrubbed":27,"log_size":4682,"log_dups_size":0,"ondisk_log_size":4682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:06:34.546712+0000","scrub_duration":383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107063120,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":42,"num_read_kb":32,"num_write":4630,"num_write_kb":171206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:42.612900+0000","last_change":"2024-09-13T11:16:42.612900+0000","last_active":"2024-09-13T11:16:42.612900+0000","last_peered":"2024-09-13T11:16:42.612900+0000","last_clean":"2024-09-13T11:16:42.612900+0000","last_became_active":"2024-09-13T11:11:57.611782+0000","last_became_peered":"2024-09-13T11:11:57.611782+0000","last_unstale":"2024-09-13T11:16:42.612900+0000","last_undegraded":"2024-09-13T11:16:42.612900+0000","last_fullsized":"2024-09-13T11:16:42.612900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:42.612731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:42.612731+0000","last_clean_scrub_stamp":"2024-09-13T11:16:42.612731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:19.740173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00096784900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'8170","reported_seq":8203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:34.919855+0000","last_change":"2024-09-13T11:16:34.919855+0000","last_active":"2024-09-13T11:16:34.919855+0000","last_peered":"2024-09-13T11:16:34.919855+0000","last_clean":"2024-09-13T11:16:34.919855+0000","last_became_active":"2024-09-13T11:12:05.888409+0000","last_became_peered":"2024-09-13T11:12:05.888409+0000","last_unstale":"2024-09-13T11:16:34.919855+0000","last_undegraded":"2024-09-13T11:16:34.919855+0000","last_fullsized":"2024-09-13T11:16:34.919855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8170","last_scrub_stamp":"2024-09-13T11:16:34.919757+0000","last_deep_scrub":"25'8170","last_deep_scrub_stamp":"2024-09-13T11:16:34.919757+0000","last_clean_scrub_stamp":"2024-09-13T11:16:34.919757+0000","objects_scrubbed":34,"log_size":8170,"log_dups_size":0,"ondisk_log_size":8170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:30.136369+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543104,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":8142,"num_write_kb":253572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:33.442208+0000","last_change":"2024-09-13T11:16:33.442208+0000","last_active":"2024-09-13T11:16:33.442208+0000","last_peered":"2024-09-13T11:16:33.442208+0000","last_clean":"2024-09-13T11:16:33.442208+0000","last_became_active":"2024-09-13T11:11:57.611944+0000","last_became_peered":"2024-09-13T11:11:57.611944+0000","last_unstale":"2024-09-13T11:16:33.442208+0000","last_undegraded":"2024-09-13T11:16:33.442208+0000","last_fullsized":"2024-09-13T11:16:33.442208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:33.442035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:33.442035+0000","last_clean_scrub_stamp":"2024-09-13T11:16:33.442035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:04.034045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012695339999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4779","reported_seq":4806,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.729862+0000","last_change":"2024-09-13T11:16:37.729862+0000","last_active":"2024-09-13T11:16:37.729862+0000","last_peered":"2024-09-13T11:16:37.729862+0000","last_clean":"2024-09-13T11:16:37.729862+0000","last_became_active":"2024-09-13T11:12:05.726919+0000","last_became_peered":"2024-09-13T11:12:05.726919+0000","last_unstale":"2024-09-13T11:16:37.729862+0000","last_undegraded":"2024-09-13T11:16:37.729862+0000","last_fullsized":"2024-09-13T11:16:37.729862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4779","last_scrub_stamp":"2024-09-13T11:16:37.729590+0000","last_deep_scrub":"25'4779","last_deep_scrub_stamp":"2024-09-13T11:16:37.729590+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.729590+0000","objects_scrubbed":24,"log_size":4779,"log_dups_size":0,"ondisk_log_size":4779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:25.420677+0000","scrub_duration":347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4753,"num_write_kb":177157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'6516","reported_seq":6868,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:35.364129+0000","last_change":"2024-09-13T11:16:35.364129+0000","last_active":"2024-09-13T11:16:35.364129+0000","last_peered":"2024-09-13T11:16:35.364129+0000","last_clean":"2024-09-13T11:16:35.364129+0000","last_became_active":"2024-09-13T11:12:05.715353+0000","last_became_peered":"2024-09-13T11:12:05.715353+0000","last_unstale":"2024-09-13T11:16:35.364129+0000","last_undegraded":"2024-09-13T11:16:35.364129+0000","last_fullsized":"2024-09-13T11:16:35.364129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6516","last_scrub_stamp":"2024-09-13T11:16:35.363975+0000","last_deep_scrub":"25'6516","last_deep_scrub_stamp":"2024-09-13T11:16:35.363975+0000","last_clean_scrub_stamp":"2024-09-13T11:16:35.363975+0000","objects_scrubbed":28,"log_size":6516,"log_dups_size":0,"ondisk_log_size":6516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:36:26.968348+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":1078,"num_read_kb":960,"num_write":6740,"num_write_kb":218838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"25'3","reported_seq":43,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:36.355462+0000","last_change":"2024-09-13T11:16:36.355462+0000","last_active":"2024-09-13T11:16:36.355462+0000","last_peered":"2024-09-13T11:16:36.355462+0000","last_clean":"2024-09-13T11:16:36.355462+0000","last_became_active":"2024-09-13T11:11:57.143730+0000","last_became_peered":"2024-09-13T11:11:57.143730+0000","last_unstale":"2024-09-13T11:16:36.355462+0000","last_undegraded":"2024-09-13T11:16:36.355462+0000","last_fullsized":"2024-09-13T11:16:36.355462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-09-13T11:16:36.355337+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-09-13T11:16:36.355337+0000","last_clean_scrub_stamp":"2024-09-13T11:16:36.355337+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:59.280528+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0033515770000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"25'3610","reported_seq":3638,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:35.832521+0000","last_change":"2024-09-13T11:16:35.832521+0000","last_active":"2024-09-13T11:16:35.832521+0000","last_peered":"2024-09-13T11:16:35.832521+0000","last_clean":"2024-09-13T11:16:35.832521+0000","last_became_active":"2024-09-13T11:12:05.889331+0000","last_became_peered":"2024-09-13T11:12:05.889331+0000","last_unstale":"2024-09-13T11:16:35.832521+0000","last_undegraded":"2024-09-13T11:16:35.832521+0000","last_fullsized":"2024-09-13T11:16:35.832521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3610","last_scrub_stamp":"2024-09-13T11:16:35.832435+0000","last_deep_scrub":"25'3610","last_deep_scrub_stamp":"2024-09-13T11:16:35.832435+0000","last_clean_scrub_stamp":"2024-09-13T11:16:35.832435+0000","objects_scrubbed":25,"log_size":3610,"log_dups_size":0,"ondisk_log_size":3610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:54.663651+0000","scrub_duration":311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3535,"num_write_kb":168833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:34.244550+0000","last_change":"2024-09-13T11:16:34.244550+0000","last_active":"2024-09-13T11:16:34.244550+0000","last_peered":"2024-09-13T11:16:34.244550+0000","last_clean":"2024-09-13T11:16:34.244550+0000","last_became_active":"2024-09-13T11:11:57.579483+0000","last_became_peered":"2024-09-13T11:11:57.579483+0000","last_unstale":"2024-09-13T11:16:34.244550+0000","last_undegraded":"2024-09-13T11:16:34.244550+0000","last_fullsized":"2024-09-13T11:16:34.244550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:34.244471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:34.244471+0000","last_clean_scrub_stamp":"2024-09-13T11:16:34.244471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:29:54.134520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053491400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"25'3849","reported_seq":3877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:35.224028+0000","last_change":"2024-09-13T11:16:35.224028+0000","last_active":"2024-09-13T11:16:35.224028+0000","last_peered":"2024-09-13T11:16:35.224028+0000","last_clean":"2024-09-13T11:16:35.224028+0000","last_became_active":"2024-09-13T11:12:05.716555+0000","last_became_peered":"2024-09-13T11:12:05.716555+0000","last_unstale":"2024-09-13T11:16:35.224028+0000","last_undegraded":"2024-09-13T11:16:35.224028+0000","last_fullsized":"2024-09-13T11:16:35.224028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3849","last_scrub_stamp":"2024-09-13T11:16:35.223930+0000","last_deep_scrub":"25'3849","last_deep_scrub_stamp":"2024-09-13T11:16:35.223930+0000","last_clean_scrub_stamp":"2024-09-13T11:16:35.223930+0000","objects_scrubbed":31,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:01:07.796762+0000","scrub_duration":431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3789,"num_write_kb":161030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.555327+0000","last_change":"2024-09-13T11:16:37.555327+0000","last_active":"2024-09-13T11:16:37.555327+0000","last_peered":"2024-09-13T11:16:37.555327+0000","last_clean":"2024-09-13T11:16:37.555327+0000","last_became_active":"2024-09-13T11:11:57.147857+0000","last_became_peered":"2024-09-13T11:11:57.147857+0000","last_unstale":"2024-09-13T11:16:37.555327+0000","last_undegraded":"2024-09-13T11:16:37.555327+0000","last_fullsized":"2024-09-13T11:16:37.555327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T11:16:37.555149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T11:16:37.555149+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.555149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:12:44.474570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010879450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"25'5173","reported_seq":5220,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.097590+0000","last_change":"2024-09-13T11:16:37.097590+0000","last_active":"2024-09-13T11:16:37.097590+0000","last_peered":"2024-09-13T11:16:37.097590+0000","last_clean":"2024-09-13T11:16:37.097590+0000","last_became_active":"2024-09-13T11:12:05.717715+0000","last_became_peered":"2024-09-13T11:12:05.717715+0000","last_unstale":"2024-09-13T11:16:37.097590+0000","last_undegraded":"2024-09-13T11:16:37.097590+0000","last_fullsized":"2024-09-13T11:16:37.097590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5173","last_scrub_stamp":"2024-09-13T11:16:37.097398+0000","last_deep_scrub":"25'5173","last_deep_scrub_stamp":"2024-09-13T11:16:37.097398+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.097398+0000","objects_scrubbed":26,"log_size":5173,"log_dups_size":0,"ondisk_log_size":5173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:51:08.644462+0000","scrub_duration":431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":72,"num_read_kb":59,"num_write":5176,"num_write_kb":147263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:35.344312+0000","last_change":"2024-09-13T11:16:35.344312+0000","last_active":"2024-09-13T11:16:35.344312+0000","last_peered":"2024-09-13T11:16:35.344312+0000","last_clean":"2024-09-13T11:16:35.344312+0000","last_became_active":"2024-09-13T11:11:57.144546+0000","last_became_peered":"2024-09-13T11:11:57.144546+0000","last_unstale":"2024-09-13T11:16:35.344312+0000","last_undegraded":"2024-09-13T11:16:35.344312+0000","last_fullsized":"2024-09-13T11:16:35.344312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-09-13T11:16:35.344032+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-09-13T11:16:35.344032+0000","last_clean_scrub_stamp":"2024-09-13T11:16:35.344032+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:14:51.917477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013361099999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"25'74","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:36.528300+0000","last_change":"2024-09-13T11:16:36.528300+0000","last_active":"2024-09-13T11:16:36.528300+0000","last_peered":"2024-09-13T11:16:36.528300+0000","last_clean":"2024-09-13T11:16:36.528300+0000","last_became_active":"2024-09-13T11:11:49.099511+0000","last_became_peered":"2024-09-13T11:11:49.099511+0000","last_unstale":"2024-09-13T11:16:36.528300+0000","last_undegraded":"2024-09-13T11:16:36.528300+0000","last_fullsized":"2024-09-13T11:16:36.528300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-09-13T11:16:36.528080+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-09-13T11:16:36.528080+0000","last_clean_scrub_stamp":"2024-09-13T11:16:36.528080+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:25.481076+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"25'3001","reported_seq":3038,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:35.969915+0000","last_change":"2024-09-13T11:16:35.969915+0000","last_active":"2024-09-13T11:16:35.969915+0000","last_peered":"2024-09-13T11:16:35.969915+0000","last_clean":"2024-09-13T11:16:35.969915+0000","last_became_active":"2024-09-13T11:12:05.700153+0000","last_became_peered":"2024-09-13T11:12:05.700153+0000","last_unstale":"2024-09-13T11:16:35.969915+0000","last_undegraded":"2024-09-13T11:16:35.969915+0000","last_fullsized":"2024-09-13T11:16:35.969915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3001","last_scrub_stamp":"2024-09-13T11:16:35.969796+0000","last_deep_scrub":"25'3001","last_deep_scrub_stamp":"2024-09-13T11:16:35.969796+0000","last_clean_scrub_stamp":"2024-09-13T11:16:35.969796+0000","objects_scrubbed":26,"log_size":3001,"log_dups_size":0,"ondisk_log_size":3001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:56:16.793719+0000","scrub_duration":307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104988672,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":36,"num_read_kb":29,"num_write":2914,"num_write_kb":144131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"25'8282","reported_seq":8438,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.476068+0000","last_change":"2024-09-13T11:16:37.476068+0000","last_active":"2024-09-13T11:16:37.476068+0000","last_peered":"2024-09-13T11:16:37.476068+0000","last_clean":"2024-09-13T11:16:37.476068+0000","last_became_active":"2024-09-13T11:12:05.888170+0000","last_became_peered":"2024-09-13T11:12:05.888170+0000","last_unstale":"2024-09-13T11:16:37.476068+0000","last_undegraded":"2024-09-13T11:16:37.476068+0000","last_fullsized":"2024-09-13T11:16:37.476068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8282","last_scrub_stamp":"2024-09-13T11:16:37.475933+0000","last_deep_scrub":"25'8282","last_deep_scrub_stamp":"2024-09-13T11:16:37.475933+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.475933+0000","objects_scrubbed":28,"log_size":8282,"log_dups_size":0,"ondisk_log_size":8282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:53.235529+0000","scrub_duration":503,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114688000,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":443,"num_read_kb":398,"num_write":6304,"num_write_kb":189330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"25'5198","reported_seq":5229,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:37.652850+0000","last_change":"2024-09-13T11:16:37.652850+0000","last_active":"2024-09-13T11:16:37.652850+0000","last_peered":"2024-09-13T11:16:37.652850+0000","last_clean":"2024-09-13T11:16:37.652850+0000","last_became_active":"2024-09-13T11:12:05.726759+0000","last_became_peered":"2024-09-13T11:12:05.726759+0000","last_unstale":"2024-09-13T11:16:37.652850+0000","last_undegraded":"2024-09-13T11:16:37.652850+0000","last_fullsized":"2024-09-13T11:16:37.652850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5198","last_scrub_stamp":"2024-09-13T11:16:37.652707+0000","last_deep_scrub":"25'5198","last_deep_scrub_stamp":"2024-09-13T11:16:37.652707+0000","last_clean_scrub_stamp":"2024-09-13T11:16:37.652707+0000","objects_scrubbed":29,"log_size":5198,"log_dups_size":0,"ondisk_log_size":5198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:21.465075+0000","scrub_duration":415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":5148,"num_write_kb":185606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"25'4294","reported_seq":4334,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:40.139728+0000","last_change":"2024-09-13T11:16:40.139728+0000","last_active":"2024-09-13T11:16:40.139728+0000","last_peered":"2024-09-13T11:16:40.139728+0000","last_clean":"2024-09-13T11:16:40.139728+0000","last_became_active":"2024-09-13T11:12:05.709368+0000","last_became_peered":"2024-09-13T11:12:05.709368+0000","last_unstale":"2024-09-13T11:16:40.139728+0000","last_undegraded":"2024-09-13T11:16:40.139728+0000","last_fullsized":"2024-09-13T11:16:40.139728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4294","last_scrub_stamp":"2024-09-13T11:16:40.139597+0000","last_deep_scrub":"25'4294","last_deep_scrub_stamp":"2024-09-13T11:16:40.139597+0000","last_clean_scrub_stamp":"2024-09-13T11:16:40.139597+0000","objects_scrubbed":30,"log_size":4294,"log_dups_size":0,"ondisk_log_size":4294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:52:21.492148+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121635328,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":4285,"num_write_kb":189832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'4797","reported_seq":4832,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:38.869135+0000","last_change":"2024-09-13T11:16:38.868986+0000","last_active":"2024-09-13T11:16:38.869135+0000","last_peered":"2024-09-13T11:16:38.869135+0000","last_clean":"2024-09-13T11:16:38.869135+0000","last_became_active":"2024-09-13T11:12:05.716884+0000","last_became_peered":"2024-09-13T11:12:05.716884+0000","last_unstale":"2024-09-13T11:16:38.869135+0000","last_undegraded":"2024-09-13T11:16:38.869135+0000","last_fullsized":"2024-09-13T11:16:38.869135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4797","last_scrub_stamp":"2024-09-13T11:16:38.868774+0000","last_deep_scrub":"25'4797","last_deep_scrub_stamp":"2024-09-13T11:16:38.868774+0000","last_clean_scrub_stamp":"2024-09-13T11:16:38.868774+0000","objects_scrubbed":33,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:20.709075+0000","scrub_duration":471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130220552,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":27,"num_read_kb":83,"num_write":4732,"num_write_kb":234695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"25'3127","reported_seq":3171,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:43.915714+0000","last_change":"2024-09-13T11:16:43.915714+0000","last_active":"2024-09-13T11:16:43.915714+0000","last_peered":"2024-09-13T11:16:43.915714+0000","last_clean":"2024-09-13T11:16:43.915714+0000","last_became_active":"2024-09-13T11:12:05.730642+0000","last_became_peered":"2024-09-13T11:12:05.730642+0000","last_unstale":"2024-09-13T11:16:43.915714+0000","last_undegraded":"2024-09-13T11:16:43.915714+0000","last_fullsized":"2024-09-13T11:16:43.915714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3127","last_scrub_stamp":"2024-09-13T11:16:43.915492+0000","last_deep_scrub":"25'3127","last_deep_scrub_stamp":"2024-09-13T11:16:43.915492+0000","last_clean_scrub_stamp":"2024-09-13T11:16:43.915492+0000","objects_scrubbed":26,"log_size":3127,"log_dups_size":0,"ondisk_log_size":3127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:04:56.184397+0000","scrub_duration":347,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98697744,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":61,"num_read_kb":48,"num_write":3111,"num_write_kb":136971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"25'4845","reported_seq":4977,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:39.990306+0000","last_change":"2024-09-13T11:16:39.990306+0000","last_active":"2024-09-13T11:16:39.990306+0000","last_peered":"2024-09-13T11:16:39.990306+0000","last_clean":"2024-09-13T11:16:39.990306+0000","last_became_active":"2024-09-13T11:12:05.731054+0000","last_became_peered":"2024-09-13T11:12:05.731054+0000","last_unstale":"2024-09-13T11:16:39.990306+0000","last_undegraded":"2024-09-13T11:16:39.990306+0000","last_fullsized":"2024-09-13T11:16:39.990306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4845","last_scrub_stamp":"2024-09-13T11:16:39.990114+0000","last_deep_scrub":"25'4845","last_deep_scrub_stamp":"2024-09-13T11:16:39.990114+0000","last_clean_scrub_stamp":"2024-09-13T11:16:39.990114+0000","objects_scrubbed":30,"log_size":4845,"log_dups_size":0,"ondisk_log_size":4845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:27:57.423882+0000","scrub_duration":427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120389632,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":345,"num_read_kb":457,"num_write":5202,"num_write_kb":163956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'5341","reported_seq":5369,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:41.127409+0000","last_change":"2024-09-13T11:16:41.127409+0000","last_active":"2024-09-13T11:16:41.127409+0000","last_peered":"2024-09-13T11:16:41.127409+0000","last_clean":"2024-09-13T11:16:41.127409+0000","last_became_active":"2024-09-13T11:12:05.722874+0000","last_became_peered":"2024-09-13T11:12:05.722874+0000","last_unstale":"2024-09-13T11:16:41.127409+0000","last_undegraded":"2024-09-13T11:16:41.127409+0000","last_fullsized":"2024-09-13T11:16:41.127409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5341","last_scrub_stamp":"2024-09-13T11:16:41.127233+0000","last_deep_scrub":"25'5341","last_deep_scrub_stamp":"2024-09-13T11:16:41.127233+0000","last_clean_scrub_stamp":"2024-09-13T11:16:41.127233+0000","objects_scrubbed":37,"log_size":5341,"log_dups_size":0,"ondisk_log_size":5341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:53:49.320246+0000","scrub_duration":559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148860928,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5249,"num_write_kb":228833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"25'2514","reported_seq":2543,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:38.466197+0000","last_change":"2024-09-13T11:16:38.466068+0000","last_active":"2024-09-13T11:16:38.466197+0000","last_peered":"2024-09-13T11:16:38.466197+0000","last_clean":"2024-09-13T11:16:38.466197+0000","last_became_active":"2024-09-13T11:12:05.712482+0000","last_became_peered":"2024-09-13T11:12:05.712482+0000","last_unstale":"2024-09-13T11:16:38.466197+0000","last_undegraded":"2024-09-13T11:16:38.466197+0000","last_fullsized":"2024-09-13T11:16:38.466197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2514","last_scrub_stamp":"2024-09-13T11:16:38.465909+0000","last_deep_scrub":"25'2514","last_deep_scrub_stamp":"2024-09-13T11:16:38.465909+0000","last_clean_scrub_stamp":"2024-09-13T11:16:38.465909+0000","objects_scrubbed":19,"log_size":2514,"log_dups_size":0,"ondisk_log_size":2514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:55.514694+0000","scrub_duration":227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497984,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2455,"num_write_kb":115332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"25'4095","reported_seq":4125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:38.928156+0000","last_change":"2024-09-13T11:16:38.928045+0000","last_active":"2024-09-13T11:16:38.928156+0000","last_peered":"2024-09-13T11:16:38.928156+0000","last_clean":"2024-09-13T11:16:38.928156+0000","last_became_active":"2024-09-13T11:12:05.728964+0000","last_became_peered":"2024-09-13T11:12:05.728964+0000","last_unstale":"2024-09-13T11:16:38.928156+0000","last_undegraded":"2024-09-13T11:16:38.928156+0000","last_fullsized":"2024-09-13T11:16:38.928156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4095","last_scrub_stamp":"2024-09-13T11:16:38.927875+0000","last_deep_scrub":"25'4095","last_deep_scrub_stamp":"2024-09-13T11:16:38.927875+0000","last_clean_scrub_stamp":"2024-09-13T11:16:38.927875+0000","objects_scrubbed":25,"log_size":4095,"log_dups_size":0,"ondisk_log_size":4095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:33.148105+0000","scrub_duration":363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99232096,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":4074,"num_write_kb":180077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"25'3626","reported_seq":3659,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:36.184502+0000","last_change":"2024-09-13T11:16:36.184368+0000","last_active":"2024-09-13T11:16:36.184502+0000","last_peered":"2024-09-13T11:16:36.184502+0000","last_clean":"2024-09-13T11:16:36.184502+0000","last_became_active":"2024-09-13T11:12:05.720600+0000","last_became_peered":"2024-09-13T11:12:05.720600+0000","last_unstale":"2024-09-13T11:16:36.184502+0000","last_undegraded":"2024-09-13T11:16:36.184502+0000","last_fullsized":"2024-09-13T11:16:36.184502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3626","last_scrub_stamp":"2024-09-13T11:16:36.184190+0000","last_deep_scrub":"25'3626","last_deep_scrub_stamp":"2024-09-13T11:16:36.184190+0000","last_clean_scrub_stamp":"2024-09-13T11:16:36.184190+0000","objects_scrubbed":29,"log_size":3626,"log_dups_size":0,"ondisk_log_size":3626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:23:08.243655+0000","scrub_duration":395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":152845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"25'9078","reported_seq":9120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-13T11:16:42.083919+0000","last_change":"2024-09-13T11:16:42.083690+0000","last_active":"2024-09-13T11:16:42.083919+0000","last_peered":"2024-09-13T11:16:42.083919+0000","last_clean":"2024-09-13T11:16:42.083919+0000","last_became_active":"2024-09-13T11:12:05.729859+0000","last_became_peered":"2024-09-13T11:12:05.729859+0000","last_unstale":"2024-09-13T11:16:42.083919+0000","last_undegraded":"2024-09-13T11:16:42.083919+0000","last_fullsized":"2024-09-13T11:16:42.083919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'9078","last_scrub_stamp":"2024-09-13T11:16:42.083460+0000","last_deep_scrub":"25'9078","last_deep_scrub_stamp":"2024-09-13T11:16:42.083460+0000","last_clean_scrub_stamp":"2024-09-13T11:16:42.083460+0000","objects_scrubbed":28,"log_size":9078,"log_dups_size":0,"ondisk_log_size":9078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:07.426265+0000","scrub_duration":479,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":50,"num_read_kb":41,"num_write":9057,"num_write_kb":215054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3578749176,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2567,"num_read_kb":2583,"num_write":162772,"num_write_kb":5648753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":7157325824,"data_stored":7157236208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165419,"ondisk_log_size":165419,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542208,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286328,"kb_used_data":1102504,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93085512,"statfs":{"total":96636764160,"available":95319564288,"internally_reserved":0,"allocated":1128964096,"data_stored":1128778774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":188217803},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077864,"kb_used_data":916248,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":93293976,"statfs":{"total":96636764160,"available":95533031424,"internally_reserved":0,"allocated":938237952,"data_stored":938054313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542208,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1689676,"kb_used_data":1437884,"kb_used_omap":1,"kb_used_meta":251774,"kb_avail":92682164,"statfs":{"total":96636764160,"available":94906535936,"internally_reserved":0,"allocated":1472393216,"data_stored":1472208918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257817029},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429584,"kb_used_data":349888,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":93942256,"statfs":{"total":96636764160,"available":96196870144,"internally_reserved":0,"allocated":358285312,"data_stored":358121086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":81590725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542209,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765340,"kb_used_data":635660,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":93606500,"statfs":{"total":96636764160,"available":95853056000,"internally_reserved":0,"allocated":650915840,"data_stored":650740401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361048,"kb_used_data":303496,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94010792,"statfs":{"total":96636764160,"available":96267051008,"internally_reserved":0,"allocated":310779904,"data_stored":310608510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1335048,"kb_used_data":1137400,"kb_used_omap":1,"kb_used_meta":197630,"kb_avail":93036792,"statfs":{"total":96636764160,"available":95269675008,"internally_reserved":0,"allocated":1164697600,"data_stored":1164520406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202373575},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1289376,"kb_used_data":1109712,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":93082464,"statfs":{"total":96636764160,"available":95316443136,"internally_reserved":0,"allocated":1136345088,"data_stored":1136167918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1135489024,"data_stored":1135479632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":650649600,"data_stored":650642464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":358023168,"data_stored":358023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1164435456,"data_stored":1164422488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1472131072,"data_stored":1472111000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":937971712,"data_stored":937956376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":310517760,"data_stored":310510592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1128108032,"data_stored":1128090488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T11:16:56.943 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T11:16:57.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95f08c9640 1 Processor -- start 2024-09-13T11:16:57.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95f08c9640 1 -- start start 2024-09-13T11:16:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95f08c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f95ec0aa6d0 0x7f95ec13e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95f08c9640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec073c50 con 0x7f95ec0ab080 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95f08c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ec0ac730 con 0x7f95ec073870 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95f08c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f95ec0aab60 con 0x7f95ec0aa6d0 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f95ec0ab080 0x7f95ec13eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47592/0 (socket says 172.21.15.39:47592) 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 -- 172.21.15.39:0/1503289558 learned_addr learned my addr 172.21.15.39:0/1503289558 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e9d9b640 1 --2- 172.21.15.39:0/1503289558 >> v2:172.21.15.102:3300/0 conn(0x7f95ec0aa6d0 0x7f95ec13e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154253294 0 0) 0x7f95e40014a0 con 0x7f95ec0ab080 2024-09-13T11:16:57.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95d8003530 con 0x7f95ec0ab080 2024-09-13T11:16:57.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1607193705 0 0) 0x7f95d8003530 con 0x7f95ec0ab080 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 >> v2:172.21.15.102:3300/0 conn(0x7f95ec0aa6d0 msgr2=0x7f95ec13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 --2- 172.21.15.39:0/1503289558 >> v2:172.21.15.102:3300/0 conn(0x7f95ec0aa6d0 0x7f95ec13e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 >> v1:172.21.15.102:6789/0 conn(0x7f95ec073870 legacy=0x7f95ec144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec142820 con 0x7f95ec0ab080 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1318545008 0 0) 0x7f95e4001c50 con 0x7f95ec0ab080 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 >> v1:172.21.15.39:6789/0 conn(0x7f95ec0ab080 legacy=0x7f95ec13eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d8003a60 0x7f95d8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d8004810 0x7f95d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95d80053d0 0x7f95d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec0aab60 con 0x7f95d80053d0 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95d800c240 con 0x7f95d8004810 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f95d800c440 con 0x7f95d8003a60 2024-09-13T11:16:57.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95d80053d0 0x7f95d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ea59c640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d8003a60 0x7f95d8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95e9d9b640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d8004810 0x7f95d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 -- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d8003a60 msgr2=0x7f95d8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d8003a60 0x7f95d8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 -- 172.21.15.39:0/1503289558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d8004810 msgr2=0x7f95d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95d8004810 0x7f95d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ead9d640 1 -- 172.21.15.39:0/1503289558 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d8003530 con 0x7f95d80053d0 2024-09-13T11:16:57.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.049+0000 7f95ea59c640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d8003a60 0x7f95d8003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T11:16:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95ead9d640 1 -- 172.21.15.39:0/1503289558 reap_dead start 2024-09-13T11:16:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95ead9d640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95d80053d0 0x7f95d800b9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f95e400aa00 tx=0x7f95e401d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad8e2af7eb42214 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0013e0 con 0x7f95d80053d0 2024-09-13T11:16:57.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e40ac660 con 0x7f95d80053d0 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95e959a640 1 -- 172.21.15.39:0/1503289558 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e400a650 con 0x7f95d80053d0 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 -- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95d80053d0 msgr2=0x7f95d800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95d80053d0 0x7f95d800b9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f95e400aa00 tx=0x7f95e401d280 comp rx=0 tx=0).stop 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 -- 172.21.15.39:0/1503289558 shutdown_connections 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 --2- 172.21.15.39:0/1503289558 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95d80053d0 0x7f95d800b9d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 -- 172.21.15.39:0/1503289558 >> 172.21.15.39:0/1503289558 conn(0x7f95ec06d460 msgr2=0x7f95ec0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 -- 172.21.15.39:0/1503289558 shutdown_connections 2024-09-13T11:16:57.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.053+0000 7f95f08c9640 1 -- 172.21.15.39:0/1503289558 wait complete. 2024-09-13T11:16:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 Processor -- start 2024-09-13T11:16:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- start start 2024-09-13T11:16:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 0x7f95ec0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95ec0b1750 0x7f95ec1406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec0af240 0x7f95ec0af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec145090 con 0x7f95ec0b1750 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec144f10 con 0x7f95ec0af240 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_getmap magic: 0 -- 0x7f95ec145210 con 0x7f95d80053d0 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 0x7f95ec0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e9d9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95ec0b1750 0x7f95ec1406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 --2- >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 0x7f95ec0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3301/0 says I am v2:172.21.15.39:33102/0 (socket says 172.21.15.39:33102) 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 -- 172.21.15.39:0/577599812 learned_addr learned my addr 172.21.15.39:0/577599812 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ead9d640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec0af240 0x7f95ec0af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 -- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec0af240 msgr2=0x7f95ec0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec0af240 0x7f95ec0af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 -- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95ec0b1750 msgr2=0x7f95ec1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95ec0b1750 0x7f95ec1406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 -- 172.21.15.39:0/577599812 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec0b0fe0 con 0x7f95d80053d0 2024-09-13T11:16:57.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95ea59c640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 0x7f95ec0aeaf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00f650 tx=0x7f95dc00fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0052e0 con 0x7f95d80053d0 2024-09-13T11:16:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc018070 con 0x7f95d80053d0 2024-09-13T11:16:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc003820 con 0x7f95d80053d0 2024-09-13T11:16:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec0afbf0 con 0x7f95d80053d0 2024-09-13T11:16:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec139a00 con 0x7f95d80053d0 2024-09-13T11:16:57.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec13e770 con 0x7f95d80053d0 2024-09-13T11:16:57.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 4 ==== mgrmap(e 5) ==== 96010+0+0 (secure 0 0 0) 0x7f95dc0039c0 con 0x7f95d80053d0 2024-09-13T11:16:57.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e2ffd640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f95cc072130 0x7f95cc0745f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T11:16:57.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.057+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5645+0+0 (secure 0 0 0) 0x7f95dc092660 con 0x7f95d80053d0 2024-09-13T11:16:57.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.061+0000 7f95e9d9b640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f95cc072130 0x7f95cc0745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T11:16:57.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.061+0000 7f95e9d9b640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f95cc072130 0x7f95cc0745f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0b0950 tx=0x7f95d4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T11:16:57.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.065+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f95dc001030 con 0x7f95d80053d0 2024-09-13T11:16:57.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.229+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 --> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f95ec074cb0 con 0x7f95d80053d0 2024-09-13T11:16:57.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.237+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f95dc005480 con 0x7f95d80053d0 2024-09-13T11:16:57.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.237+0000 7f95e2ffd640 1 -- 172.21.15.39:0/577599812 <== mon.2 v2:172.21.15.39:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f95dc05d9b0 con 0x7f95d80053d0 2024-09-13T11:16:57.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f95cc072130 msgr2=0x7f95cc0745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f95cc072130 0x7f95cc0745f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0b0950 tx=0x7f95d4009190 comp rx=0 tx=0).stop 2024-09-13T11:16:57.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 msgr2=0x7f95ec0aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 0x7f95ec0aeaf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00f650 tx=0x7f95dc00fa50 comp rx=0 tx=0).stop 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 shutdown_connections 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:6832/259014220,v1:172.21.15.102:6833/259014220] conn(0x7f95cc072130 0x7f95cc0745f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ec0af240 0x7f95ec0af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95ec0b1750 0x7f95ec1406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 --2- 172.21.15.39:0/577599812 >> [v2:172.21.15.39:3301/0,v1:172.21.15.39:6790/0] conn(0x7f95d80053d0 0x7f95ec0aeaf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 >> 172.21.15.39:0/577599812 conn(0x7f95ec06d460 msgr2=0x7f95ec0b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 shutdown_connections 2024-09-13T11:16:57.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-09-13T11:16:57.241+0000 7f95f08c9640 1 -- 172.21.15.39:0/577599812 wait complete. 2024-09-13T11:16:57.260 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T11:16:57.260 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T11:16:57.260 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T11:16:57.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:16:57.353 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T11:16:57.353 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T11:16:57.353 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:16:57.453 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T11:16:57.453 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T11:16:57.453 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:03.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-13T11:17:03.554 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T11:17:03.555 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T11:17:03.555 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:09.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T11:17:09.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-13T11:17:09.656 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T11:17:09.656 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T11:17:09.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:09.732 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T11:17:09.732 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T11:17:09.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:14.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T11:17:14.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T11:17:15.833 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T11:17:15.833 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T11:17:15.833 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:15.917 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T11:17:15.917 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T11:17:15.918 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:16.017 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T11:17:16.017 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T11:17:16.017 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T11:17:16.017 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:16.047 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T11:17:16.047 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T11:17:16.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:16.078 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T11:17:16.078 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T11:17:16.079 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T11:17:16.079 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:16.112 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T11:17:16.112 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T11:17:16.112 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:16.173 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T11:17:16.173 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T11:17:16.173 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T11:17:16.197 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T11:17:16.198 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T11:17:16.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-09-13T11:17:16.230 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:17:16.230 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T11:17:16.542 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:17:16.542 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T11:17:16.762 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:17:16.762 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T11:17:16.950 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:17:16.950 DEBUG:teuthology.orchestra.run.smithi039:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T11:17:17.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:17:17.142 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T11:17:17.362 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:17:17.362 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T11:17:17.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:17:17.555 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T11:17:17.725 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:17:17.725 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T11:17:17.915 INFO:tasks.ceph:Archiving mon data... 2024-09-13T11:17:17.916 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/data/mon.a.tgz 2024-09-13T11:17:17.916 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-13T11:17:17.923 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.M5D8vmuwfu 2024-09-13T11:17:17.923 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.M5D8vmuwfu 2024-09-13T11:17:18.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.M5D8vmuwfu 2024-09-13T11:17:18.104 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.M5D8vmuwfu is 322KB 2024-09-13T11:17:18.122 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.M5D8vmuwfu 2024-09-13T11:17:18.127 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/data/mon.c.tgz 2024-09-13T11:17:18.127 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-09-13T11:17:18.172 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.GqXXUTJmLE 2024-09-13T11:17:18.172 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.GqXXUTJmLE 2024-09-13T11:17:18.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.GqXXUTJmLE 2024-09-13T11:17:18.351 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.GqXXUTJmLE is 325KB 2024-09-13T11:17:18.410 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.GqXXUTJmLE 2024-09-13T11:17:18.415 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/data/mon.b.tgz 2024-09-13T11:17:18.415 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-13T11:17:18.421 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.iDwfid6BXW 2024-09-13T11:17:18.421 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.iDwfid6BXW 2024-09-13T11:17:18.540 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.iDwfid6BXW 2024-09-13T11:17:18.603 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.iDwfid6BXW is 325KB 2024-09-13T11:17:18.660 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.iDwfid6BXW 2024-09-13T11:17:18.665 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T11:17:18.666 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T11:17:18.668 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T11:17:18.728 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T11:17:18.767 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T11:17:18.767 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T11:17:18.769 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/crash to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/remote/smithi039/crash 2024-09-13T11:17:18.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T11:17:18.784 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/remote/smithi102/crash 2024-09-13T11:17:18.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T11:17:18.823 INFO:tasks.ceph:Compressing logs... 2024-09-13T11:17:18.823 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T11:17:18.837 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31434.log 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31940.log 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32314.log 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31434.log.gz 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31940.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31940.log.gz 2024-09-13T11:17:18.862 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31148.log 2024-09-13T11:17:18.864 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.32314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31150.log 2024-09-13T11:17:18.864 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31888.log 2024-09-13T11:17:18.864 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31148.log.gz 2024-09-13T11:17:18.864 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32392.log 2024-09-13T11:17:18.864 INFO:teuthology.orchestra.run.smithi039.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32314.log.gz 2024-09-13T11:17:18.864 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31888.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31150.log.gz 2024-09-13T11:17:18.865 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30583.log 2024-09-13T11:17:18.865 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30558.log 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30583.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32392.log.gz 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26507.log 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30583.log.gz 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30558.log.gz 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30734.log 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.26507.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21465.log 2024-09-13T11:17:18.867 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30734.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.26507.log.gz 2024-09-13T11:17:18.868 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32288.log 2024-09-13T11:17:18.868 INFO:teuthology.orchestra.run.smithi039.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30734.log.gz 2024-09-13T11:17:18.872 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32366.log 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.tmp-client.admin.21465.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21465.log.gz 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31865.log 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.32158.log -- replaced with /var/log/ceph/ceph-client.admin.32288.log.gz/var/log/ceph/ceph-client.admin.32366.log: 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32366.log.gz 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31123.log 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31865.log.gz 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31383.log 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32158.log: /var/log/ceph/ceph-client.admin.31123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32574.log 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32158.log.gz 2024-09-13T11:17:18.873 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.32011.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31123.log.gz 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31383.log.gz 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31920.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.32011.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32574.log.gz 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32600.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.32011.log.gz 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26256.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31920.log: /var/log/ceph/ceph-client.admin.32600.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.26256.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32600.log.gz 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26404.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31888.log.gz 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32418.log 2024-09-13T11:17:18.874 INFO:teuthology.orchestra.run.smithi039.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.26256.log.gz 2024-09-13T11:17:18.879 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.26404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30726.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26404.log.gz 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32522.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32418.log.gz 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30726.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30726.log.gz 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31407.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32522.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30942.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31407.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32522.log.gz 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31989.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30942.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31407.log.gz 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31144.log 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30942.log.gz 2024-09-13T11:17:18.880 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.32077.log 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31989.log: /var/log/ceph/ceph-client.admin.31144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30941.log 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31144.log.gz/var/log/ceph/ceph-client.libcephsqlite.32077.log: 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32262.log 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30941.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30941.log.gz 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32444.log 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.32077.log.gz 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32262.log.gz 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32444.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32444.log.gz 2024-09-13T11:17:18.881 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30727.log 2024-09-13T11:17:18.883 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30733.log 2024-09-13T11:17:18.883 INFO:teuthology.orchestra.run.smithi039.stderr: 87.9%/var/log/ceph/ceph-client.admin.30727.log: -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32210.log 2024-09-13T11:17:18.883 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30727.log.gz 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30733.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30733.log.gz 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30716.log 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32210.log.gz/var/log/ceph/ceph-osd.3.log: 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30926.log 2024-09-13T11:17:18.884 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30936.log 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30716.log: /var/log/ceph/ceph-client.admin.30926.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30926.log.gz 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30716.log.gz 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32548.log 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31920.log.gz 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30936.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30603.log 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30936.log.gz 2024-09-13T11:17:18.887 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32548.log: /var/log/ceph/ceph-osd.1.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32548.log.gz 2024-09-13T11:17:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31801.log 2024-09-13T11:17:18.888 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30943.log 2024-09-13T11:17:18.888 INFO:teuthology.orchestra.run.smithi039.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30603.log.gz 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31801.log: 90.1% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31801.log.gz 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30735.log 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31963.log 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30735.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30943.log.gz 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30735.log.gz 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.32034.log 2024-09-13T11:17:18.891 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31147.log 2024-09-13T11:17:18.893 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26380.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26452.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26428.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26380.log.gz 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26452.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26452.log.gz 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26404.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.7.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.26428.log.gz 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26500.log 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26404.log.gz 2024-09-13T11:17:18.894 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26548.log 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26500.log: /var/log/ceph/ceph-osd.5.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.26500.log.gz 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26548.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26476.log 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.26548.log.gz 2024-09-13T11:17:18.895 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T11:17:18.897 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.26476.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26476.log.gz 2024-09-13T11:17:18.897 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T11:17:18.897 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T11:17:18.897 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-13T11:17:18.897 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26524.log 2024-09-13T11:17:18.898 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T11:17:18.898 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.26524.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.26524.log.gz 2024-09-13T11:17:18.899 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.32034.log: 96.4% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31989.log.gz 2024-09-13T11:17:18.900 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30720.log 2024-09-13T11:17:18.901 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31147.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31147.log.gz 2024-09-13T11:17:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32340.log 2024-09-13T11:17:18.902 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30720.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30720.log.gz 2024-09-13T11:17:18.903 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30655.log 2024-09-13T11:17:18.904 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32340.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32340.log.gz 2024-09-13T11:17:18.904 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T11:17:18.905 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30655.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30655.log.gz 2024-09-13T11:17:18.906 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30938.log 2024-09-13T11:17:18.908 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T11:17:18.909 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31844.log 2024-09-13T11:17:18.910 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30938.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30938.log.gz 2024-09-13T11:17:18.910 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31823.log 2024-09-13T11:17:18.911 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31844.log: 90.0% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31844.log.gz 2024-09-13T11:17:18.912 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32184.log 2024-09-13T11:17:18.915 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31823.log: 91.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31823.log.gz 2024-09-13T11:17:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32132.log 2024-09-13T11:17:18.916 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32184.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32184.log.gz 2024-09-13T11:17:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30471.log 2024-09-13T11:17:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32132.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32132.log.gz 2024-09-13T11:17:18.918 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31145.log 2024-09-13T11:17:18.919 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30471.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30471.log.gz 2024-09-13T11:17:18.920 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-13T11:17:18.921 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31145.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31145.log.gz 2024-09-13T11:17:18.921 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30940.log 2024-09-13T11:17:18.936 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31458.log 2024-09-13T11:17:18.937 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30940.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30940.log.gz 2024-09-13T11:17:18.937 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31142.log 2024-09-13T11:17:18.960 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T11:17:18.964 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.libcephsqlite.31458.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T11:17:18.965 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31142.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31142.log.gz 2024-09-13T11:17:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31151.log 2024-09-13T11:17:18.974 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T11:17:18.980 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31331.log 2024-09-13T11:17:18.981 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31151.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31151.log.gz 2024-09-13T11:17:18.988 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-09-13T11:17:18.989 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31331.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31331.log.gz 2024-09-13T11:17:19.000 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32652.log 2024-09-13T11:17:19.001 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-09-13T11:17:19.016 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30724.log 2024-09-13T11:17:19.017 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32652.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32652.log.gz 2024-09-13T11:17:19.025 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-13T11:17:19.028 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32236.log 2024-09-13T11:17:19.029 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30724.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30724.log.gz 2024-09-13T11:17:19.044 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32626.log 2024-09-13T11:17:19.045 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32236.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32236.log.gz 2024-09-13T11:17:19.068 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31357.log 2024-09-13T11:17:19.069 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32626.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32626.log.gz 2024-09-13T11:17:19.084 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-09-13T11:17:19.085 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.31357.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31357.log.gz 2024-09-13T11:17:19.095 INFO:teuthology.orchestra.run.smithi039.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-13T11:17:19.103 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30629.log 2024-09-13T11:17:19.105 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32676.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-09-13T11:17:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30533.log 2024-09-13T11:17:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30629.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30629.log.gz 2024-09-13T11:17:19.134 INFO:teuthology.orchestra.run.smithi039.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31963.log.gz 2024-09-13T11:17:19.140 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32470.log 2024-09-13T11:17:19.141 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30533.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30533.log.gz 2024-09-13T11:17:19.141 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30934.log 2024-09-13T11:17:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32470.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32470.log.gz 2024-09-13T11:17:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32106.log 2024-09-13T11:17:19.143 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.30934.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30934.log.gz 2024-09-13T11:17:19.145 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/ceph-client.admin.32106.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32106.log.gz 2024-09-13T11:17:19.171 INFO:teuthology.orchestra.run.smithi039.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T11:17:19.236 INFO:teuthology.orchestra.run.smithi039.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.32034.log.gz 2024-09-13T11:17:19.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T11:17:21.226 INFO:teuthology.orchestra.run.smithi039.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31458.log.gz 2024-09-13T11:17:23.356 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-13T11:17:23.709 INFO:teuthology.orchestra.run.smithi039.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T11:17:28.805 INFO:teuthology.orchestra.run.smithi039.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T11:17:30.699 INFO:teuthology.orchestra.run.smithi102.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-13T11:17:34.257 INFO:teuthology.orchestra.run.smithi039.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T11:17:34.926 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-13T11:17:36.662 INFO:teuthology.orchestra.run.smithi102.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-13T11:17:36.663 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-13T11:17:36.663 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m17.792s 2024-09-13T11:17:36.663 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m48.703s 2024-09-13T11:17:36.664 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m1.606s 2024-09-13T11:17:37.030 INFO:teuthology.orchestra.run.smithi039.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T11:17:37.032 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-09-13T11:17:37.032 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m18.193s 2024-09-13T11:17:37.032 INFO:teuthology.orchestra.run.smithi039.stderr:user 0m50.173s 2024-09-13T11:17:37.032 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m1.474s 2024-09-13T11:17:37.032 INFO:tasks.ceph:Archiving logs... 2024-09-13T11:17:37.033 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/remote/smithi039/log 2024-09-13T11:17:37.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T11:17:43.520 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/remote/smithi102/log 2024-09-13T11:17:43.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T11:17:50.602 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T11:17:50.612 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T11:17:50.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T11:17:50.615 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T11:17:50.689 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T11:17:50.698 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T11:17:50.698 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T11:17:50.701 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T11:17:50.712 INFO:teuthology.orchestra.run.smithi039.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T11:17:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:============================================================================== 2024-09-13T11:17:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:+hv01.front.sepi 67.205.162.81 3 u 13 64 377 0.073 -0.626 0.971 2024-09-13T11:17:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:*hv02.front.sepi 63.231.80.2 3 u 12 64 377 0.068 -1.125 0.966 2024-09-13T11:17:50.712 INFO:teuthology.orchestra.run.smithi039.stdout:+hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.072 -0.137 1.020 2024-09-13T11:17:50.712 INFO:teuthology.orchestra.run.smithi039.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:17:50.713 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T11:17:50.713 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-13T11:17:50.714 INFO:teuthology.orchestra.run.smithi102.stdout:+hv01.front.sepi 67.205.162.81 3 u 10 64 377 0.080 -0.808 0.645 2024-09-13T11:17:50.714 INFO:teuthology.orchestra.run.smithi102.stdout:+hv02.front.sepi 63.231.80.2 3 u 14 64 377 0.095 -1.292 0.627 2024-09-13T11:17:50.714 INFO:teuthology.orchestra.run.smithi102.stdout:*hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.074 -1.014 0.594 2024-09-13T11:17:50.714 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T11:17:50.714 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T11:17:50.728 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T11:17:50.729 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T11:17:50.761 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T11:17:50.795 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T11:17:50.828 INFO:teuthology.task.internal:Duration was 1003.618761 seconds 2024-09-13T11:17:50.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T11:17:50.862 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T11:17:50.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T11:17:50.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T11:17:50.904 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T11:17:50.904 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-09-13T11:17:50.904 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T11:17:50.956 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-13T11:17:50.957 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T11:17:50.967 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T11:17:50.967 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T11:17:51.005 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T11:17:51.036 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T11:17:51.036 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T11:17:51.073 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T11:17:51.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T11:17:51.148 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T11:17:51.148 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T11:17:51.161 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T11:17:51.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T11:17:51.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T11:17:51.209 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T11:17:51.218 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-09-13T11:17:51.233 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-13T11:17:51.269 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T11:17:51.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:17:51.275 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T11:17:51.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T11:17:51.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T11:17:51.324 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T11:17:51.325 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/remote/smithi039 2024-09-13T11:17:51.325 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T11:17:51.349 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/akupczyk-2024-09-13_09:37:56-rados-wip-aclamk-cbt-combined-distro-default-smithi/7903394/remote/smithi102 2024-09-13T11:17:51.349 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T11:17:51.379 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T11:17:51.379 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T11:17:51.389 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T11:17:51.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T11:17:51.433 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T11:17:51.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T11:17:51.464 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T11:17:51.464 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T11:17:51.467 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T11:17:51.471 INFO:teuthology.orchestra.run.smithi039.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 11:17 /home/ubuntu/cephtest 2024-09-13T11:17:51.473 INFO:teuthology.orchestra.run.smithi102.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 11:17 /home/ubuntu/cephtest 2024-09-13T11:17:51.474 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T11:17:51.497 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T11:17:51.565 INFO:teuthology.run:Summary data: description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-hybrid} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} duration: 1003.6187608242035 flavor: default owner: scheduled_akupczyk@teuthology success: true 2024-09-13T11:17:51.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T11:17:51.645 INFO:teuthology.run:pass