2024-09-16T14:25:42.438 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T14:25:42.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T14:25:42.542 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742 branch: reef description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906742' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client: debug cephsqlite: 20 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 1500 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - POOL_APP_NOT_ENABLED - do not have an application enabled mon_bind_msgr2: false sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: ae7f37330c1a72493684eb1fcaed6f2a01195bb6 owner: scheduled_teuthology@teuthology priority: 931 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1390 sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 sleep_before_teardown: 0 subset: 5319/100000 suite: rados suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ae7f37330c1a72493684eb1fcaed6f2a01195bb6 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_system_packages: deb: - sqlite3 rpm: - sqlite-devel - ceph: null - exec: client.0: - ceph osd pool create cephsqlite - ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring - exec: client.0: - ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr - workunit: clients: client.0: - rados/test_libcephsqlite.sh cephsqlite env: CEPH_ARGS: --id libcephsqlite --no-log-to-stderr teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_22:00:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T14:25:42.542 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa; will attempt to use it 2024-09-16T14:25:42.543 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa/tasks 2024-09-16T14:25:42.543 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T14:25:42.545 INFO:teuthology.task.internal:Checking packages... 2024-09-16T14:25:42.566 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8' 2024-09-16T14:25:42.566 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T14:25:42.566 INFO:teuthology.packaging:ref: None 2024-09-16T14:25:42.566 INFO:teuthology.packaging:tag: None 2024-09-16T14:25:42.566 INFO:teuthology.packaging:branch: reef 2024-09-16T14:25:42.566 INFO:teuthology.packaging:sha1: e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:25:42.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-09-16T14:25:42.820 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-853-gae7f3733-1focal 2024-09-16T14:25:42.822 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T14:25:42.829 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T14:25:42.829 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T14:25:42.838 INFO:teuthology.task.internal:Saving configuration 2024-09-16T14:25:42.852 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T14:25:42.861 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T14:25:42.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 14:19:53.574789', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-16T14:25:42.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 14:19:53.573335', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-16T14:25:42.910 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T14:25:42.916 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-16T14:25:42.916 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-16T14:25:42.916 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T14:25:42.980 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f13c8a231c0>, signals=[15]) 2024-09-16T14:25:42.980 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T14:25:42.986 INFO:teuthology.task.internal:Opening connections... 2024-09-16T14:25:42.987 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:25:42.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:25:43.084 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:25:43.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:25:43.171 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T14:25:43.178 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-16T14:25:43.185 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-16T14:25:43.185 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-16T14:25:43.232 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="20.04" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=focal 2024-09-16T14:25:43.233 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=focal 2024-09-16T14:25:43.234 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-16T14:25:43.261 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-09-16T14:25:43.267 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-09-16T14:25:43.267 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="20.04" 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=focal 2024-09-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=focal 2024-09-16T14:25:43.322 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-09-16T14:25:43.344 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T14:25:43.354 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T14:25:43.365 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T14:25:43.365 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-16T14:25:43.367 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-09-16T14:25:43.373 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T14:25:43.379 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T14:25:43.379 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-16T14:25:43.381 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-09-16T14:25:43.399 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T14:25:43.451 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T14:25:43.465 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T14:25:43.466 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T14:25:43.466 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T14:25:43.466 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T14:25:43.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:25:43.472 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-16T14:25:43.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:25:43.473 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-09-16T14:25:43.479 INFO:teuthology.orchestra.run.smithi073.stdout:5.4.0-124-generic 2024-09-16T14:25:43.479 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.4.0-124-generic 2024-09-16T14:25:43.479 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-16T14:25:43.480 INFO:teuthology.orchestra.run.smithi177.stdout:5.4.0-124-generic 2024-09-16T14:25:43.480 INFO:teuthology.task.kernel:Running kernel on smithi177: 5.4.0-124-generic 2024-09-16T14:25:43.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get clean 2024-09-16T14:25:43.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-16T14:25:43.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2024-09-16T14:25:43.743 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-16T14:25:43.761 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T14:25:43.772 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-16T14:25:43.836 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-16T14:25:43.866 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T14:25:43.873 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-16T14:25:43.948 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-16T14:25:44.038 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-16T14:25:44.150 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,568 kB] 2024-09-16T14:25:44.169 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-16T14:25:44.182 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-16T14:25:44.186 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-16T14:25:44.187 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-16T14:25:44.187 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-16T14:25:44.207 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-16T14:25:44.211 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-16T14:25:44.211 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-16T14:25:44.217 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-16T14:25:44.225 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-16T14:25:44.225 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-16T14:25:44.225 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-16T14:25:44.225 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-16T14:25:44.225 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-16T14:25:44.235 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-16T14:25:44.302 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-16T14:25:44.302 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-16T14:25:44.319 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-16T14:25:44.323 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-16T14:25:44.323 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-16T14:25:44.324 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,240 kB] 2024-09-16T14:25:44.348 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [454 kB] 2024-09-16T14:25:44.351 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-16T14:25:44.351 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-16T14:25:44.360 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-16T14:25:44.366 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-16T14:25:44.368 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-16T14:25:44.368 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-16T14:25:44.369 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-16T14:25:44.369 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-16T14:25:44.372 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-16T14:25:44.372 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-16T14:25:44.372 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-16T14:25:44.389 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-16T14:25:44.389 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-16T14:25:44.389 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-16T14:25:44.390 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-16T14:25:44.442 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,568 kB] 2024-09-16T14:25:44.492 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-16T14:25:44.826 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-16T14:25:44.827 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-16T14:25:44.856 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-16T14:25:44.868 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-16T14:25:44.868 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,240 kB] 2024-09-16T14:25:44.962 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-16T14:25:44.962 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [454 kB] 2024-09-16T14:25:44.983 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-16T14:25:44.983 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-16T14:25:44.999 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-16T14:25:45.019 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-16T14:25:45.032 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-16T14:25:45.033 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-16T14:25:45.033 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-16T14:25:45.043 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-16T14:25:45.044 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-16T14:25:45.044 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-16T14:25:45.074 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-16T14:25:45.074 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-16T14:25:45.074 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-16T14:25:45.075 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-16T14:25:45.126 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-16T14:25:45.126 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-16T14:25:45.139 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-16T14:25:45.139 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-16T14:25:45.155 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-16T14:25:45.155 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-16T14:25:45.156 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-16T14:25:45.156 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-16T14:25:45.157 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-16T14:25:45.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-16T14:25:45.191 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-16T14:25:45.191 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-16T14:25:45.191 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-16T14:25:45.264 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-16T14:25:45.264 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-16T14:25:48.594 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 21.9 MB in 3s (7,400 kB/s) 2024-09-16T14:25:48.696 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 21.9 MB in 3s (7,088 kB/s) 2024-09-16T14:25:50.231 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:25:50.237 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:25:50.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:25:50.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:25:50.341 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:25:50.352 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:25:50.534 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T14:25:50.535 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T14:25:50.570 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-09-16T14:25:50.571 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-09-16T14:25:50.730 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-16T14:25:50.730 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-16T14:25:50.730 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-16T14:25:50.730 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-16T14:25:50.731 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-16T14:25:50.731 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-16T14:25:50.731 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-16T14:25:50.731 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-09-16T14:25:50.774 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-09-16T14:25:50.774 INFO:teuthology.orchestra.run.smithi177.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-16T14:25:50.774 INFO:teuthology.orchestra.run.smithi177.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-16T14:25:50.775 INFO:teuthology.orchestra.run.smithi177.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-16T14:25:50.776 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-09-16T14:25:50.776 INFO:teuthology.orchestra.run.smithi177.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-16T14:25:50.776 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2024-09-16T14:25:50.776 INFO:teuthology.orchestra.run.smithi177.stdout: thermald 2024-09-16T14:25:50.793 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-16T14:25:50.793 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-16T14:25:50.793 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-16T14:25:50.793 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-16T14:25:50.794 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-16T14:25:50.795 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T14:25:50.832 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-09-16T14:25:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-16T14:25:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-16T14:25:50.832 INFO:teuthology.orchestra.run.smithi177.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-16T14:25:50.833 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2024-09-16T14:25:50.834 INFO:teuthology.orchestra.run.smithi177.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-16T14:25:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-16T14:25:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 77.2 MB of archives. 2024-09-16T14:25:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-16T14:25:50.979 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-16T14:25:51.017 INFO:teuthology.orchestra.run.smithi177.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-16T14:25:51.017 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 77.2 MB of archives. 2024-09-16T14:25:51.017 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-16T14:25:51.018 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-16T14:25:52.117 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-16T14:25:52.188 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-16T14:25:52.390 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-16T14:25:52.460 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-16T14:25:53.740 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-16T14:25:53.740 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-16T14:25:53.741 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-16T14:25:53.785 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-16T14:25:53.785 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-16T14:25:53.785 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-16T14:25:54.068 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-16T14:25:54.070 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-16T14:25:54.084 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-16T14:25:54.084 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-16T14:25:54.773 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 77.2 MB in 3s (23.8 MB/s) 2024-09-16T14:25:54.775 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 77.2 MB in 3s (23.5 MB/s) 2024-09-16T14:25:54.957 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-16T14:25:54.990 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-16T14:25:56.722 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-16T14:25:56.727 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:25:56.805 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-16T14:25:56.809 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:25:56.838 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:25:56.996 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:25:58.781 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-16T14:25:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:25:58.902 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:25:59.021 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-16T14:25:59.036 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:25:59.157 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:00.026 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-16T14:26:00.042 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:26:00.084 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:00.258 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-16T14:26:00.272 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:26:00.316 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:04.982 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T14:26:05.142 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T14:26:05.390 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T14:26:05.487 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T14:26:05.514 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T14:26:05.638 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T14:26:05.891 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T14:26:05.974 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-16T14:26:05.988 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-16T14:26:06.032 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-16T14:26:06.042 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T14:26:06.412 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-16T14:26:06.427 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-16T14:26:06.470 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-16T14:26:11.434 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-16T14:26:11.455 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:26:11.500 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:13.214 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-16T14:26:13.235 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-16T14:26:13.272 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:14.202 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T14:26:14.355 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T14:26:14.901 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:16.102 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:17.236 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-16T14:26:17.248 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-16T14:26:17.248 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:17.379 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:17.382 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-16T14:26:17.793 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:18.531 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-16T14:26:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-16T14:26:18.808 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:18.942 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-16T14:26:19.021 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:19.068 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-16T14:26:19.212 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:19.281 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T14:26:19.281 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:20.183 INFO:teuthology.orchestra.run.smithi177.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-16T14:26:20.184 INFO:teuthology.orchestra.run.smithi177.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:20.331 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:21.541 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-16T14:26:21.692 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-16T14:26:21.819 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:21.961 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-16T14:26:22.121 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-16T14:26:22.326 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-16T14:26:23.083 INFO:teuthology.orchestra.run.smithi177.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-16T14:26:23.084 INFO:teuthology.orchestra.run.smithi177.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T14:26:41.219 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-09-16T14:26:41.238 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:26:41.253 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-09-16T14:26:41.650 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-16T14:26:41.679 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:42.134 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-16T14:26:42.145 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-16T14:26:44.892 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-09-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi177.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi177.stdout:Sourcing file `/etc/default/grub' 2024-09-16T14:26:45.222 INFO:teuthology.orchestra.run.smithi177.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:26:45.250 INFO:teuthology.orchestra.run.smithi177.stdout:Generating grub configuration file ... 2024-09-16T14:26:45.331 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-16T14:26:45.371 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-16T14:26:45.371 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-16T14:26:45.371 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-16T14:26:45.371 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-16T14:26:45.371 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 20 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.4.0.195.193 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:26:45.372 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-16T14:26:45.373 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-16T14:26:45.373 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T14:26:45.373 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T14:26:45.373 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-16T14:26:45.373 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T14:26:45.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-09-16T14:26:45.484 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-16T14:26:45.646 INFO:teuthology.orchestra.run.smithi177.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-16T14:26:45.673 INFO:teuthology.orchestra.run.smithi177.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:45.762 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-16T14:26:45.768 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T14:26:45.850 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-16T14:26:45.932 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-16T14:26:46.106 INFO:teuthology.orchestra.run.smithi177.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-16T14:26:46.118 INFO:teuthology.orchestra.run.smithi177.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-16T14:26:47.627 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:26:47.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:26:47.724 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:26:47.917 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T14:26:47.917 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T14:26:48.146 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-16T14:26:48.146 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-16T14:26:48.148 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-09-16T14:26:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-09-16T14:26:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-09-16T14:26:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-09-16T14:26:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-09-16T14:26:48.167 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 20 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.4.0.195.193 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:26:48.168 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-09-16T14:26:48.169 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-16T14:26:48.173 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.Pa9AJ8I5Ug 2024-09-16T14:26:48.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Pa9AJ8I5Ug 2024-09-16T14:26:48.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.Pa9AJ8I5Ug 2024-09-16T14:26:48.204 INFO:teuthology.orchestra.run.smithi177.stdout:done 2024-09-16T14:26:48.262 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.Pa9AJ8I5Ug is 9KB 2024-09-16T14:26:48.277 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.Pa9AJ8I5Ug 2024-09-16T14:26:48.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T14:26:48.297 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:26:48.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T14:26:48.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T14:26:48.324 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-16T14:26:48.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-09-16T14:26:48.658 DEBUG:teuthology.orchestra.run.smithi177:> dpkg -s linux-image-generic 2024-09-16T14:26:48.706 INFO:teuthology.orchestra.run.smithi177.stdout:Package: linux-image-generic 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Status: install ok installed 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Priority: optional 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Section: kernel 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Installed-Size: 20 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: amd64 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Source: linux-meta 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Version: 5.4.0.195.193 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Recommends: thermald 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout:Description: Generic Linux kernel image 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:26:48.707 INFO:teuthology.orchestra.run.smithi177.stdout: available. 2024-09-16T14:26:48.708 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-16T14:26:48.708 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T14:26:48.708 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T14:26:48.708 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-16T14:26:48.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T14:26:48.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get clean 2024-09-16T14:26:48.834 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2024-09-16T14:26:48.966 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-16T14:26:49.086 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T14:26:49.167 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-16T14:26:49.256 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-16T14:26:49.793 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-09-16T14:26:49.804 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:26:49.854 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-16T14:26:50.160 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-16T14:26:50.172 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:50.582 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-16T14:26:50.594 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-16T14:26:50.808 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:26:50.835 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-16T14:26:50.908 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:26:51.102 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-09-16T14:26:51.103 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-09-16T14:26:51.337 INFO:teuthology.orchestra.run.smithi177.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-16T14:26:51.338 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-16T14:26:51.339 DEBUG:teuthology.orchestra.run.smithi177:> dpkg -s linux-image-generic 2024-09-16T14:26:51.362 INFO:teuthology.orchestra.run.smithi177.stdout:Package: linux-image-generic 2024-09-16T14:26:51.362 INFO:teuthology.orchestra.run.smithi177.stdout:Status: install ok installed 2024-09-16T14:26:51.362 INFO:teuthology.orchestra.run.smithi177.stdout:Priority: optional 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Section: kernel 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Installed-Size: 20 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Maintainer: Ubuntu Kernel Team 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: amd64 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Source: linux-meta 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Version: 5.4.0.195.193 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Recommends: thermald 2024-09-16T14:26:51.363 INFO:teuthology.orchestra.run.smithi177.stdout:Description: Generic Linux kernel image 2024-09-16T14:26:51.364 INFO:teuthology.orchestra.run.smithi177.stdout: This package will always depend on the latest generic kernel image 2024-09-16T14:26:51.364 INFO:teuthology.orchestra.run.smithi177.stdout: available. 2024-09-16T14:26:51.364 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-09-16T14:26:51.369 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.wYs2UKhdEX 2024-09-16T14:26:51.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wYs2UKhdEX 2024-09-16T14:26:51.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.wYs2UKhdEX 2024-09-16T14:26:51.432 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.wYs2UKhdEX is 9KB 2024-09-16T14:26:51.445 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.wYs2UKhdEX 2024-09-16T14:26:51.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-16T14:26:51.509 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:26:51.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-16T14:26:51.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-16T14:26:51.555 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-16T14:26:51.556 DEBUG:teuthology.orchestra.run.smithi177:> sudo update-grub 2024-09-16T14:26:52.195 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-16T14:26:52.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-16T14:26:52.963 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2024-09-16T14:26:52.972 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-16T14:26:52.982 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-09-16T14:26:53.282 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-16T14:26:53.294 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-16T14:26:53.691 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-16T14:26:53.702 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-16T14:26:54.797 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-09-16T14:26:54.797 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-09-16T14:27:22.226 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-16T14:27:22.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:27:22.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:27:24.802 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-16T14:27:24.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:27:24.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:27:40.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-16T14:27:43.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-09-16T14:27:49.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:27:49.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:27:52.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:27:52.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:27:52.797 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-16T14:27:55.357 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-09-16T14:28:04.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:28:04.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:28:07.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:28:07.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:28:23.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-09-16T14:28:25.789 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-09-16T14:28:38.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:28:38.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:28:38.479 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-16T14:28:39.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:28:39.077 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-16T14:28:39.078 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-16T14:28:39.084 INFO:teuthology.orchestra.run.smithi073.stdout:5.4.0-195-generic 2024-09-16T14:28:39.084 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-16T14:28:39.084 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T14:28:39.084 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T14:28:40.085 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-16T14:28:40.085 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T14:28:40.171 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-16T14:28:40.195 DEBUG:teuthology.parallel:result is None 2024-09-16T14:28:40.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:28:40.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:28:41.030 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-16T14:28:41.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:28:41.614 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-195-generic"... 2024-09-16T14:28:41.614 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-09-16T14:28:41.620 INFO:teuthology.orchestra.run.smithi177.stdout:5.4.0-195-generic 2024-09-16T14:28:41.620 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-16T14:28:41.621 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T14:28:41.621 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-16T14:28:42.621 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-16T14:28:42.621 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T14:28:42.717 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2024-09-16T14:28:42.736 DEBUG:teuthology.parallel:result is None 2024-09-16T14:28:42.737 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T14:28:42.744 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T14:28:42.745 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T14:28:42.747 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T14:28:42.754 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T14:28:42.760 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T14:28:42.767 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T14:28:42.767 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T14:28:42.794 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T14:28:42.812 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T14:28:42.818 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T14:28:42.818 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T14:28:42.821 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T14:28:42.835 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:28:42.839 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:28:42.842 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:28:42.848 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T14:28:42.850 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T14:28:42.856 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T14:28:42.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T14:28:42.859 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T14:28:42.911 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T14:28:42.919 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T14:28:42.919 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T14:28:42.921 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T14:28:42.928 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T14:28:42.934 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T14:28:42.941 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:28:42.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T14:28:43.005 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T14:28:43.012 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T14:28:43.061 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:28:43.061 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T14:28:43.083 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-16T14:28:43.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-09-16T14:28:43.131 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T14:28:43.139 INFO:teuthology.task.internal:Starting timer... 2024-09-16T14:28:43.139 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T14:28:43.150 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T14:28:43.158 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-09-16T14:28:43.158 DEBUG:teuthology.task.selinux:Excluding smithi177: OS 'ubuntu' does not support SELinux 2024-09-16T14:28:43.158 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T14:28:43.158 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-16T14:28:43.158 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T14:28:43.158 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T14:28:43.166 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T14:28:43.169 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T14:28:43.279 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T14:28:43.290 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T14:28:43.291 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T14:34:19.129 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-09-16T14:34:19.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:34:19.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:34:19.263 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-16T14:34:19.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-16T14:34:19.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:34:19.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T14:34:19.485 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-09-16T14:34:19.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-09-16T14:34:19.611 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T14:34:19.622 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T14:34:19.622 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T14:34:19.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:34:19.625 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T14:34:19.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:34:19.661 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-16T14:34:19.662 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Command line: ntpd -gq 2024-09-16T14:34:19.662 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: proto: precision = 0.100 usec (-23) 2024-09-16T14:34:19.662 INFO:teuthology.orchestra.run.smithi177.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:34:19.662 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:34:19.663 INFO:teuthology.orchestra.run.smithi177.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listen normally on 3 enp3s0f1 172.21.15.177:123 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listen normally on 4 lo [::1]:123 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feea:b04b%5]:123 2024-09-16T14:34:19.665 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:19 ntpd[13685]: Listening on routing socket on fd #22 for interface updates 2024-09-16T14:34:19.666 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-16T14:34:19.666 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Command line: ntpd -gq 2024-09-16T14:34:19.666 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: proto: precision = 0.117 usec (-23) 2024-09-16T14:34:19.667 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:34:19.667 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-16T14:34:19.667 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:34:19.668 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: restrict ::: KOD does nothing without LIMITED. 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listen and drop on 0 v6wildcard [::]:123 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listen normally on 2 lo 127.0.0.1:123 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listen normally on 4 lo [::1]:123 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-09-16T14:34:19.669 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:19 ntpd[13655]: Listening on routing socket on fd #22 for interface updates 2024-09-16T14:34:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:20 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:20.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:20 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:20 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:20 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:20 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:20.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:20 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:21.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:21 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:21.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:21 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:22.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:22 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:22.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:22 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:22.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:22 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:22.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:22 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:22.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:22 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:22.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:22 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:22 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:22 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:22 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:22 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:22 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:22.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:22 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:23.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:23.662 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:23 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:23.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.664 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:23.665 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:23.666 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:23 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:24.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:24 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:24.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:24 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:24.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:24 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:24.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:24 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:24.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:24 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:24.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:24 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:24 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:24 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:24 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:24 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:24 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:24.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:24 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:25.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:25.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:25 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:25.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:25.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:25 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:26.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:26 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:26.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:26 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:26.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:26 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:26.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:26 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:26.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:26 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:26.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:26 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:26.662 INFO:teuthology.orchestra.run.smithi073.stdout:16 Sep 14:34:26 ntpd[13655]: ntpd: time slew -0.000150 s 2024-09-16T14:34:26.663 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.000150s 2024-09-16T14:34:26.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T14:34:26.663 INFO:teuthology.orchestra.run.smithi073.stderr:16 Sep 14:34:26 ntpd[13655]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T14:34:26.726 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:34:26.726 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-16T14:34:26.726 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:26.726 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:26.726 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:26.726 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:27.658 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: can't open /var/log/ntpstats/rawstats.20240916: Permission denied 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: can't open /var/log/ntpstats/peerstats.20240916: Permission denied 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stdout:16 Sep 14:34:27 ntpd[13685]: ntpd: time slew -0.000736 s 2024-09-16T14:34:27.659 INFO:teuthology.orchestra.run.smithi177.stdout:ntpd: time slew -0.000736s 2024-09-16T14:34:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-16T14:34:27.660 INFO:teuthology.orchestra.run.smithi177.stderr:16 Sep 14:34:27 ntpd[13685]: can't open /var/log/ntpstats/loopstats.20240916: Permission denied 2024-09-16T14:34:27.731 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:34:27.731 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2024-09-16T14:34:27.731 INFO:teuthology.orchestra.run.smithi177.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:27.731 INFO:teuthology.orchestra.run.smithi177.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:27.731 INFO:teuthology.orchestra.run.smithi177.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:27.732 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:34:27.732 INFO:teuthology.run_tasks:Running task install... 2024-09-16T14:34:27.741 DEBUG:teuthology.task.install:project ceph 2024-09-16T14:34:27.741 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}} 2024-09-16T14:34:27.741 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'} 2024-09-16T14:34:27.741 INFO:teuthology.task.install:Using flavor: default 2024-09-16T14:34:27.747 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T14:34:27.747 INFO:teuthology.task.install:extra packages: [] 2024-09-16T14:34:27.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-09-16T14:34:27.749 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-key list | grep Ceph 2024-09-16T14:34:27.850 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-16T14:34:27.877 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-16T14:34:27.909 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T14:34:27.909 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T14:34:27.910 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T14:34:27.910 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-09-16T14:34:27.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:34:27.945 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-16T14:34:27.945 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph.com (release key) 2024-09-16T14:34:27.945 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-16T14:34:27.945 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-09-16T14:34:27.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:34:28.053 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default/ 2024-09-16T14:34:28.054 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1focal 2024-09-16T14:34:28.093 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default/ 2024-09-16T14:34:28.093 INFO:teuthology.task.install.deb:Package version is 18.2.4-845-ge4e227b3-1focal 2024-09-16T14:34:28.165 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:34:28.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T14:34:28.180 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-09-16T14:34:28.204 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:34:28.204 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-16T14:34:28.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2024-09-16T14:34:28.327 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T14:34:28.331 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-16T14:34:28.349 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-16T14:34:28.359 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-16T14:34:28.364 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-16T14:34:28.382 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-16T14:34:28.383 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal InRelease 2024-09-16T14:34:28.405 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-16T14:34:28.415 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal InRelease 2024-09-16T14:34:28.428 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release.gpg 2024-09-16T14:34:28.436 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-16T14:34:28.442 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-16T14:34:28.449 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2024-09-16T14:34:28.460 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal Release.gpg 2024-09-16T14:34:28.477 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-16T14:34:28.481 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-16T14:34:28.483 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-16T14:34:28.513 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main i386 Packages [3,420 B] 2024-09-16T14:34:28.981 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 28.7 kB in 1s (45.6 kB/s) 2024-09-16T14:34:29.008 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 28.7 kB in 1s (45.6 kB/s) 2024-09-16T14:34:30.126 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:34:30.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1focal cephadm=18.2.4-845-ge4e227b3-1focal ceph-mds=18.2.4-845-ge4e227b3-1focal ceph-mgr=18.2.4-845-ge4e227b3-1focal ceph-common=18.2.4-845-ge4e227b3-1focal ceph-fuse=18.2.4-845-ge4e227b3-1focal ceph-test=18.2.4-845-ge4e227b3-1focal ceph-volume=18.2.4-845-ge4e227b3-1focal radosgw=18.2.4-845-ge4e227b3-1focal python3-rados=18.2.4-845-ge4e227b3-1focal python3-rgw=18.2.4-845-ge4e227b3-1focal python3-cephfs=18.2.4-845-ge4e227b3-1focal python3-rbd=18.2.4-845-ge4e227b3-1focal libcephfs2=18.2.4-845-ge4e227b3-1focal libcephfs-dev=18.2.4-845-ge4e227b3-1focal librados2=18.2.4-845-ge4e227b3-1focal librbd1=18.2.4-845-ge4e227b3-1focal rbd-fuse=18.2.4-845-ge4e227b3-1focal 2024-09-16T14:34:30.172 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:34:30.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-845-ge4e227b3-1focal cephadm=18.2.4-845-ge4e227b3-1focal ceph-mds=18.2.4-845-ge4e227b3-1focal ceph-mgr=18.2.4-845-ge4e227b3-1focal ceph-common=18.2.4-845-ge4e227b3-1focal ceph-fuse=18.2.4-845-ge4e227b3-1focal ceph-test=18.2.4-845-ge4e227b3-1focal ceph-volume=18.2.4-845-ge4e227b3-1focal radosgw=18.2.4-845-ge4e227b3-1focal python3-rados=18.2.4-845-ge4e227b3-1focal python3-rgw=18.2.4-845-ge4e227b3-1focal python3-cephfs=18.2.4-845-ge4e227b3-1focal python3-rbd=18.2.4-845-ge4e227b3-1focal libcephfs2=18.2.4-845-ge4e227b3-1focal libcephfs-dev=18.2.4-845-ge4e227b3-1focal librados2=18.2.4-845-ge4e227b3-1focal librbd1=18.2.4-845-ge4e227b3-1focal rbd-fuse=18.2.4-845-ge4e227b3-1focal 2024-09-16T14:34:30.221 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:34:30.272 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:34:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T14:34:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T14:34:30.489 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-09-16T14:34:30.489 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-09-16T14:34:30.633 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:34:30.634 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-16T14:34:30.635 INFO:teuthology.orchestra.run.smithi073.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-16T14:34:30.636 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-16T14:34:30.637 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T14:34:30.638 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-16T14:34:30.639 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-09-16T14:34:30.639 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-09-16T14:34:30.686 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-16T14:34:30.688 INFO:teuthology.orchestra.run.smithi177.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-16T14:34:30.690 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-16T14:34:30.690 INFO:teuthology.orchestra.run.smithi177.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-16T14:34:30.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-16T14:34:30.690 INFO:teuthology.orchestra.run.smithi177.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-16T14:34:30.691 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2024-09-16T14:34:30.692 INFO:teuthology.orchestra.run.smithi177.stdout: btrfs-tools 2024-09-16T14:34:30.752 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-16T14:34:30.752 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T14:34:30.752 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T14:34:30.752 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-16T14:34:30.754 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-09-16T14:34:30.755 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet 2024-09-16T14:34:30.756 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-16T14:34:30.756 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 librbd1 2024-09-16T14:34:30.808 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-09-16T14:34:30.808 INFO:teuthology.orchestra.run.smithi177.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-16T14:34:30.808 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-16T14:34:30.808 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-16T14:34:30.810 INFO:teuthology.orchestra.run.smithi177.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-09-16T14:34:30.810 INFO:teuthology.orchestra.run.smithi177.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-09-16T14:34:30.810 INFO:teuthology.orchestra.run.smithi177.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-16T14:34:30.810 INFO:teuthology.orchestra.run.smithi177.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-09-16T14:34:30.810 INFO:teuthology.orchestra.run.smithi177.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-09-16T14:34:30.810 INFO:teuthology.orchestra.run.smithi177.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-16T14:34:30.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-09-16T14:34:30.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-09-16T14:34:30.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-09-16T14:34:30.812 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet 2024-09-16T14:34:30.812 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2024-09-16T14:34:30.812 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 librbd1 2024-09-16T14:34:30.876 INFO:teuthology.orchestra.run.smithi177.stdout:2 upgraded, 110 newly installed, 0 to remove and 295 not upgraded. 2024-09-16T14:34:30.876 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 199 MB of archives. 2024-09-16T14:34:30.876 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 977 MB of additional disk space will be used. 2024-09-16T14:34:30.876 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-16T14:34:30.903 INFO:teuthology.orchestra.run.smithi073.stdout:2 upgraded, 110 newly installed, 0 to remove and 295 not upgraded. 2024-09-16T14:34:30.903 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 199 MB of archives. 2024-09-16T14:34:30.903 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 977 MB of additional disk space will be used. 2024-09-16T14:34:30.903 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1focal [3,451 kB] 2024-09-16T14:34:30.949 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-16T14:34:30.959 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-16T14:34:30.962 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-16T14:34:30.963 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-845-ge4e227b3-1focal [3,451 kB] 2024-09-16T14:34:30.980 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-16T14:34:31.032 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-16T14:34:31.034 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-16T14:34:31.040 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-16T14:34:31.042 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-16T14:34:31.043 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-16T14:34:31.044 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-16T14:34:31.044 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-16T14:34:31.047 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-16T14:34:31.048 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-16T14:34:31.049 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-16T14:34:31.066 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-16T14:34:31.066 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-16T14:34:31.067 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-16T14:34:31.069 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T14:34:31.069 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-16T14:34:31.069 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-16T14:34:31.070 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-16T14:34:31.071 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-16T14:34:31.072 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-16T14:34:31.078 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1focal [4,042 kB] 2024-09-16T14:34:31.084 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-16T14:34:31.091 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-16T14:34:31.097 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-16T14:34:31.097 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-16T14:34:31.098 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-16T14:34:31.098 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-16T14:34:31.100 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-16T14:34:31.102 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-16T14:34:31.102 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-16T14:34:31.105 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-16T14:34:31.117 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-16T14:34:31.119 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-16T14:34:31.120 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-16T14:34:31.120 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-16T14:34:31.121 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-16T14:34:31.134 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-16T14:34:31.136 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-16T14:34:31.136 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-16T14:34:31.137 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-16T14:34:31.138 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-16T14:34:31.151 INFO:teuthology.orchestra.run.smithi177.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T14:34:31.152 INFO:teuthology.orchestra.run.smithi177.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-16T14:34:31.153 INFO:teuthology.orchestra.run.smithi177.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-16T14:34:31.154 INFO:teuthology.orchestra.run.smithi177.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-16T14:34:31.155 INFO:teuthology.orchestra.run.smithi177.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-16T14:34:31.158 INFO:teuthology.orchestra.run.smithi177.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-845-ge4e227b3-1focal [4,042 kB] 2024-09-16T14:34:31.168 INFO:teuthology.orchestra.run.smithi177.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-16T14:34:31.169 INFO:teuthology.orchestra.run.smithi177.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-16T14:34:31.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1focal [746 kB] 2024-09-16T14:34:31.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1focal [387 kB] 2024-09-16T14:34:31.222 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1focal [31.9 kB] 2024-09-16T14:34:31.223 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1focal [200 kB] 2024-09-16T14:34:31.225 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1focal [62.5 kB] 2024-09-16T14:34:31.227 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1focal [368 kB] 2024-09-16T14:34:31.233 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1focal [6,630 kB] 2024-09-16T14:34:31.251 INFO:teuthology.orchestra.run.smithi177.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-16T14:34:31.266 INFO:teuthology.orchestra.run.smithi177.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-16T14:34:31.267 INFO:teuthology.orchestra.run.smithi177.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-16T14:34:31.279 INFO:teuthology.orchestra.run.smithi177.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-16T14:34:31.279 INFO:teuthology.orchestra.run.smithi177.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-16T14:34:31.279 INFO:teuthology.orchestra.run.smithi177.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-16T14:34:31.341 INFO:teuthology.orchestra.run.smithi177.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-16T14:34:31.341 INFO:teuthology.orchestra.run.smithi177.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-845-ge4e227b3-1focal [746 kB] 2024-09-16T14:34:31.341 INFO:teuthology.orchestra.run.smithi177.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-16T14:34:31.341 INFO:teuthology.orchestra.run.smithi177.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-16T14:34:31.342 INFO:teuthology.orchestra.run.smithi177.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-16T14:34:31.344 INFO:teuthology.orchestra.run.smithi177.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-16T14:34:31.345 INFO:teuthology.orchestra.run.smithi177.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-16T14:34:31.353 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-16T14:34:31.354 INFO:teuthology.orchestra.run.smithi177.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-845-ge4e227b3-1focal [387 kB] 2024-09-16T14:34:31.356 INFO:teuthology.orchestra.run.smithi177.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-16T14:34:31.357 INFO:teuthology.orchestra.run.smithi177.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-845-ge4e227b3-1focal [31.9 kB] 2024-09-16T14:34:31.357 INFO:teuthology.orchestra.run.smithi177.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-845-ge4e227b3-1focal [200 kB] 2024-09-16T14:34:31.359 INFO:teuthology.orchestra.run.smithi177.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-16T14:34:31.361 INFO:teuthology.orchestra.run.smithi177.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-16T14:34:31.361 INFO:teuthology.orchestra.run.smithi177.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-845-ge4e227b3-1focal [62.5 kB] 2024-09-16T14:34:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-845-ge4e227b3-1focal [368 kB] 2024-09-16T14:34:31.367 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-16T14:34:31.369 INFO:teuthology.orchestra.run.smithi177.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-845-ge4e227b3-1focal [6,630 kB] 2024-09-16T14:34:31.374 INFO:teuthology.orchestra.run.smithi177.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-16T14:34:31.375 INFO:teuthology.orchestra.run.smithi177.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-16T14:34:31.379 INFO:teuthology.orchestra.run.smithi177.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-16T14:34:31.383 INFO:teuthology.orchestra.run.smithi177.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-16T14:34:31.398 INFO:teuthology.orchestra.run.smithi177.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-16T14:34:31.401 INFO:teuthology.orchestra.run.smithi177.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-16T14:34:31.402 INFO:teuthology.orchestra.run.smithi177.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-16T14:34:31.430 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1focal [113 kB] 2024-09-16T14:34:31.441 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1focal [478 kB] 2024-09-16T14:34:31.444 INFO:teuthology.orchestra.run.smithi177.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-16T14:34:31.445 INFO:teuthology.orchestra.run.smithi177.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-16T14:34:31.446 INFO:teuthology.orchestra.run.smithi177.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-16T14:34:31.446 INFO:teuthology.orchestra.run.smithi177.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-16T14:34:31.449 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1focal [25.2 MB] 2024-09-16T14:34:31.451 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-16T14:34:31.457 INFO:teuthology.orchestra.run.smithi177.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T14:34:31.457 INFO:teuthology.orchestra.run.smithi177.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-16T14:34:31.458 INFO:teuthology.orchestra.run.smithi177.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-16T14:34:31.458 INFO:teuthology.orchestra.run.smithi177.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-16T14:34:31.459 INFO:teuthology.orchestra.run.smithi177.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-16T14:34:31.600 INFO:teuthology.orchestra.run.smithi177.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-845-ge4e227b3-1focal [113 kB] 2024-09-16T14:34:31.601 INFO:teuthology.orchestra.run.smithi177.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-845-ge4e227b3-1focal [478 kB] 2024-09-16T14:34:31.636 INFO:teuthology.orchestra.run.smithi177.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-845-ge4e227b3-1focal [25.2 MB] 2024-09-16T14:34:31.694 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-16T14:34:31.703 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-16T14:34:31.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-16T14:34:31.739 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-16T14:34:31.740 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-16T14:34:31.743 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-16T14:34:31.745 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-16T14:34:31.757 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-16T14:34:31.759 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-16T14:34:31.776 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-16T14:34:31.846 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-16T14:34:31.847 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-16T14:34:31.847 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-16T14:34:31.849 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-16T14:34:31.850 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-16T14:34:31.850 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-16T14:34:31.853 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-16T14:34:31.854 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-16T14:34:31.859 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-16T14:34:31.939 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-16T14:34:31.940 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-16T14:34:31.949 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-16T14:34:31.949 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-16T14:34:31.950 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-16T14:34:31.951 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-16T14:34:31.953 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-16T14:34:31.955 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-16T14:34:32.021 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-16T14:34:32.026 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-16T14:34:32.102 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-16T14:34:32.106 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-16T14:34:32.109 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-16T14:34:32.110 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-16T14:34:32.111 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-16T14:34:32.113 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-16T14:34:32.115 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-16T14:34:32.115 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-16T14:34:32.184 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-16T14:34:32.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-16T14:34:32.199 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-16T14:34:32.199 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-16T14:34:32.201 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-16T14:34:32.202 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-16T14:34:32.266 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-16T14:34:32.267 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-16T14:34:32.268 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-16T14:34:32.366 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1focal [9,611 kB] 2024-09-16T14:34:32.542 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1focal [238 kB] 2024-09-16T14:34:32.545 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1focal [148 kB] 2024-09-16T14:34:32.547 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1focal [1,574 kB] 2024-09-16T14:34:32.559 INFO:teuthology.orchestra.run.smithi177.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-845-ge4e227b3-1focal [9,611 kB] 2024-09-16T14:34:32.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1focal [6,640 kB] 2024-09-16T14:34:32.630 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-16T14:34:32.651 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-16T14:34:32.652 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-16T14:34:32.732 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-16T14:34:32.732 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-16T14:34:32.733 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-16T14:34:32.733 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-16T14:34:32.734 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-16T14:34:32.735 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-16T14:34:32.735 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-16T14:34:32.795 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1focal [24.5 MB] 2024-09-16T14:34:32.795 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-16T14:34:32.795 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-16T14:34:32.862 INFO:teuthology.orchestra.run.smithi177.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-845-ge4e227b3-1focal [238 kB] 2024-09-16T14:34:32.866 INFO:teuthology.orchestra.run.smithi177.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-845-ge4e227b3-1focal [148 kB] 2024-09-16T14:34:32.869 INFO:teuthology.orchestra.run.smithi177.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-845-ge4e227b3-1focal [1,574 kB] 2024-09-16T14:34:32.877 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-16T14:34:32.882 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-16T14:34:32.886 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-16T14:34:32.890 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-16T14:34:32.891 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-16T14:34:32.895 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-16T14:34:32.897 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-16T14:34:32.922 INFO:teuthology.orchestra.run.smithi177.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-845-ge4e227b3-1focal [6,640 kB] 2024-09-16T14:34:32.968 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-16T14:34:32.974 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-16T14:34:32.975 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-16T14:34:33.137 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-16T14:34:33.138 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-16T14:34:33.138 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-16T14:34:33.139 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-16T14:34:33.188 INFO:teuthology.orchestra.run.smithi177.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-845-ge4e227b3-1focal [24.5 MB] 2024-09-16T14:34:33.205 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-16T14:34:33.206 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-16T14:34:33.208 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-16T14:34:33.208 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-16T14:34:33.209 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-16T14:34:33.594 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1focal [13.7 kB] 2024-09-16T14:34:33.595 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1focal [856 kB] 2024-09-16T14:34:33.608 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1focal [2,295 kB] 2024-09-16T14:34:33.634 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1focal [239 kB] 2024-09-16T14:34:33.637 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1focal [143 kB] 2024-09-16T14:34:33.639 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1focal [7,015 kB] 2024-09-16T14:34:33.853 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1focal [7,882 kB] 2024-09-16T14:34:34.095 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1focal [13.9 kB] 2024-09-16T14:34:34.095 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1focal [46.9 MB] 2024-09-16T14:34:34.158 INFO:teuthology.orchestra.run.smithi177.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-845-ge4e227b3-1focal [13.7 kB] 2024-09-16T14:34:34.159 INFO:teuthology.orchestra.run.smithi177.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-845-ge4e227b3-1focal [856 kB] 2024-09-16T14:34:34.171 INFO:teuthology.orchestra.run.smithi177.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-845-ge4e227b3-1focal [2,295 kB] 2024-09-16T14:34:34.232 INFO:teuthology.orchestra.run.smithi177.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-845-ge4e227b3-1focal [239 kB] 2024-09-16T14:34:34.235 INFO:teuthology.orchestra.run.smithi177.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-845-ge4e227b3-1focal [143 kB] 2024-09-16T14:34:34.237 INFO:teuthology.orchestra.run.smithi177.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-845-ge4e227b3-1focal [7,015 kB] 2024-09-16T14:34:34.588 INFO:teuthology.orchestra.run.smithi177.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-845-ge4e227b3-1focal [7,882 kB] 2024-09-16T14:34:34.993 INFO:teuthology.orchestra.run.smithi177.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-845-ge4e227b3-1focal [13.9 kB] 2024-09-16T14:34:34.993 INFO:teuthology.orchestra.run.smithi177.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-845-ge4e227b3-1focal [46.9 MB] 2024-09-16T14:34:36.149 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1focal [120 kB] 2024-09-16T14:34:36.151 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1focal [37.4 kB] 2024-09-16T14:34:36.152 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1focal [13.5 MB] 2024-09-16T14:34:36.539 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1focal [107 kB] 2024-09-16T14:34:37.013 INFO:teuthology.orchestra.run.smithi177.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-845-ge4e227b3-1focal [120 kB] 2024-09-16T14:34:37.015 INFO:teuthology.orchestra.run.smithi177.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-845-ge4e227b3-1focal [37.4 kB] 2024-09-16T14:34:37.016 INFO:teuthology.orchestra.run.smithi177.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-845-ge4e227b3-1focal [13.5 MB] 2024-09-16T14:34:37.180 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 199 MB in 6s (34.4 MB/s) 2024-09-16T14:34:37.193 INFO:teuthology.orchestra.run.smithi177.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/e4e227b37858f5109138494e01e5ba1ba7b8ffe8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-845-ge4e227b3-1focal [107 kB] 2024-09-16T14:34:37.345 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-16T14:34:37.401 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-16T14:34:37.405 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-16T14:34:37.485 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-16T14:34:37.830 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 199 MB in 6s (31.2 MB/s) 2024-09-16T14:34:37.839 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T14:34:37.855 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-16T14:34:37.898 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-16T14:34:37.997 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-16T14:34:38.053 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-16T14:34:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-16T14:34:38.137 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-16T14:34:38.267 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T14:34:38.283 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-16T14:34:38.325 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-16T14:34:38.507 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-16T14:34:38.525 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-16T14:34:38.565 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-16T14:34:38.695 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T14:34:38.714 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T14:34:38.781 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:34:38.885 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-16T14:34:38.907 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-16T14:34:38.952 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-16T14:34:39.307 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T14:34:39.324 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T14:34:39.355 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-16T14:34:39.366 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:34:39.371 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T14:34:39.415 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:34:39.727 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T14:34:39.746 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T14:34:39.785 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:34:39.941 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-16T14:34:39.957 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T14:34:39.999 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:34:40.122 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-16T14:34:40.139 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-16T14:34:40.172 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-16T14:34:40.328 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-16T14:34:40.347 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-16T14:34:40.386 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:34:40.557 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-librbd1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:40.683 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-16T14:34:40.747 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-16T14:34:40.764 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-16T14:34:40.805 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-16T14:34:41.208 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../007-librbd1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:41.333 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librbd1 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-16T14:34:41.395 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:41.530 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-16T14:34:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../008-librados2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:42.146 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librados2 (18.2.4-845-ge4e227b3-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-16T14:34:42.259 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T14:34:42.274 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:42.317 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:42.636 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-09-16T14:34:42.654 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-python3-rados_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:42.694 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:42.883 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs2. 2024-09-16T14:34:42.898 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../009-libcephfs2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:42.941 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:43.040 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T14:34:43.055 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:34:43.089 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:43.285 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rados. 2024-09-16T14:34:43.300 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T14:34:43.302 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../010-python3-rados_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:43.318 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:43.343 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:43.358 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:43.663 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-16T14:34:43.682 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:34:43.711 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T14:34:43.721 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:43.727 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:34:43.769 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:43.965 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cephfs. 2024-09-16T14:34:43.982 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../012-python3-cephfs_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:44.015 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:44.033 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T14:34:44.051 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-16T14:34:44.091 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-16T14:34:44.342 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-16T14:34:44.343 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T14:34:44.360 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:44.360 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:34:44.400 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:44.435 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:44.745 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-prettytable. 2024-09-16T14:34:44.761 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-09-16T14:34:44.779 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-16T14:34:44.798 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-16T14:34:44.803 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-16T14:34:44.838 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-16T14:34:45.056 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rbd. 2024-09-16T14:34:45.072 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../015-python3-rbd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:45.114 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:45.141 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-16T14:34:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-16T14:34:45.191 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-16T14:34:45.458 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-16T14:34:45.474 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-16T14:34:45.508 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-16T14:34:45.527 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T14:34:45.544 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-16T14:34:45.585 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-16T14:34:45.853 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-16T14:34:45.872 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-16T14:34:45.930 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-09-16T14:34:45.936 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-16T14:34:45.947 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:45.988 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:46.264 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-16T14:34:46.280 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-16T14:34:46.322 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-16T14:34:46.700 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librgw2. 2024-09-16T14:34:46.717 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../019-librgw2_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:46.758 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:46.891 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T14:34:46.910 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:46.949 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:47.293 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0. 2024-09-16T14:34:47.309 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-16T14:34:47.351 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-16T14:34:47.663 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T14:34:47.679 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:47.794 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rgw. 2024-09-16T14:34:47.797 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:47.814 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:47.852 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liboath0. 2024-09-16T14:34:48.246 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-16T14:34:48.288 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-16T14:34:48.325 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-09-16T14:34:48.340 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:48.383 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:48.624 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libradosstriper1. 2024-09-16T14:34:48.641 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:48.682 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:49.128 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-common. 2024-09-16T14:34:49.147 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../023-ceph-common_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:49.177 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:50.880 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-09-16T14:34:50.896 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:50.948 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:51.541 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-base. 2024-09-16T14:34:51.557 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../024-ceph-base_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:51.601 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:52.276 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T14:34:52.294 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-16T14:34:52.334 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-16T14:34:52.713 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T14:34:52.729 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-16T14:34:52.771 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-16T14:34:52.837 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-16T14:34:52.853 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-16T14:34:52.895 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-16T14:34:53.066 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T14:34:53.085 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-16T14:34:53.124 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-16T14:34:53.223 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-natsort. 2024-09-16T14:34:53.243 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-09-16T14:34:53.281 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-16T14:34:53.418 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T14:34:53.434 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-16T14:34:53.468 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-16T14:34:53.618 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-logutils. 2024-09-16T14:34:53.634 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-09-16T14:34:53.676 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-16T14:34:53.738 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-09-16T14:34:53.755 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-16T14:34:53.796 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-16T14:34:54.012 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-16T14:34:54.031 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-16T14:34:54.070 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-16T14:34:54.166 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T14:34:54.183 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T14:34:54.224 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:34:54.373 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-mako. 2024-09-16T14:34:54.389 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-16T14:34:54.431 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-16T14:34:54.510 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T14:34:54.529 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-16T14:34:54.568 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-16T14:34:54.784 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-16T14:34:54.801 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-16T14:34:54.842 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:34:54.879 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-09-16T14:34:54.896 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-16T14:34:54.938 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-16T14:34:55.137 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-16T14:34:55.153 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-16T14:34:55.195 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-16T14:34:55.274 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-16T14:34:55.291 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-16T14:34:55.332 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-16T14:34:55.525 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webob. 2024-09-16T14:34:55.538 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-16T14:34:55.581 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-16T14:34:55.619 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bs4. 2024-09-16T14:34:55.638 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-16T14:34:55.702 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-16T14:34:55.884 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-16T14:34:55.903 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-16T14:34:55.942 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-16T14:34:56.055 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T14:34:56.072 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-16T14:34:56.116 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-16T14:34:56.278 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bs4. 2024-09-16T14:34:56.294 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-09-16T14:34:56.328 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-16T14:34:56.483 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T14:34:56.502 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-16T14:34:56.541 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-16T14:34:56.622 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-waitress. 2024-09-16T14:34:56.640 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-16T14:34:56.701 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-16T14:34:56.844 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-09-16T14:34:56.862 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-16T14:34:56.902 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-16T14:34:57.001 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempita. 2024-09-16T14:34:57.019 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-09-16T14:34:57.058 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-16T14:34:57.214 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T14:34:57.230 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-16T14:34:57.289 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-16T14:34:57.320 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-paste. 2024-09-16T14:34:57.339 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-16T14:34:57.394 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-16T14:34:57.600 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T14:34:57.616 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-16T14:34:57.658 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-16T14:34:57.698 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-16T14:34:57.715 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-16T14:34:57.756 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-16T14:34:57.980 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T14:34:57.997 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-16T14:34:58.036 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-16T14:34:58.083 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-16T14:34:58.100 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-16T14:34:58.141 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-16T14:34:58.339 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T14:34:58.358 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-16T14:34:58.397 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-16T14:34:58.453 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webtest. 2024-09-16T14:34:58.469 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-09-16T14:34:58.511 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-16T14:34:58.736 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T14:34:58.752 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-16T14:34:58.794 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-16T14:34:58.847 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pecan. 2024-09-16T14:34:58.867 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-16T14:34:58.905 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-16T14:34:59.105 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T14:34:59.123 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:34:59.163 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:59.252 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-16T14:34:59.271 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-16T14:34:59.310 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-16T14:34:59.542 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T14:34:59.562 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:34:59.600 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:59.610 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-16T14:34:59.627 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:34:59.668 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:34:59.953 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T14:34:59.973 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-16T14:35:00.011 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-16T14:35:00.031 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-16T14:35:00.051 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:00.114 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:00.314 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cryptography. 2024-09-16T14:35:00.331 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-16T14:35:00.372 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-16T14:35:00.417 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-16T14:35:00.433 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-16T14:35:00.474 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-16T14:35:00.776 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T14:35:00.792 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-16T14:35:00.802 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cryptography. 2024-09-16T14:35:00.818 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-16T14:35:00.834 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-16T14:35:00.861 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-16T14:35:01.170 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T14:35:01.188 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:01.223 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-openssl. 2024-09-16T14:35:01.228 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:01.239 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-16T14:35:01.281 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-16T14:35:01.643 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr. 2024-09-16T14:35:01.658 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../048-ceph-mgr_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:01.701 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:01.707 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T14:35:01.724 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:01.766 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:02.229 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mon. 2024-09-16T14:35:02.245 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../049-ceph-mon_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:02.287 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:02.703 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T14:35:02.719 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:02.761 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:03.970 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-osd. 2024-09-16T14:35:03.988 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../050-ceph-osd_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:04.028 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:05.151 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-09-16T14:35:05.168 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:05.210 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:05.562 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T14:35:05.579 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:05.620 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:06.047 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T14:35:06.066 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:06.106 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:06.181 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph. 2024-09-16T14:35:06.197 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../051-ceph_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:06.254 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:06.582 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-fuse. 2024-09-16T14:35:06.598 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../052-ceph-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:06.634 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-09-16T14:35:06.640 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:06.651 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-cephadm_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:06.692 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:07.045 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T14:35:07.063 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-16T14:35:07.076 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mds. 2024-09-16T14:35:07.095 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../053-ceph-mds_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:07.103 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-16T14:35:07.134 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:07.473 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T14:35:07.488 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-16T14:35:07.530 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-16T14:35:07.679 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephadm. 2024-09-16T14:35:07.696 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../054-cephadm_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:07.737 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:07.851 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T14:35:07.870 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:07.909 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:08.065 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-16T14:35:08.081 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-16T14:35:08.123 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-16T14:35:08.262 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jwt. 2024-09-16T14:35:08.282 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-16T14:35:08.320 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-16T14:35:08.510 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jinja2. 2024-09-16T14:35:08.526 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-16T14:35:08.567 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-16T14:35:08.655 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-attr. 2024-09-16T14:35:08.674 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-16T14:35:08.715 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-16T14:35:08.937 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-16T14:35:08.954 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:09.046 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:09.051 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T14:35:09.068 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-16T14:35:09.109 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-16T14:35:09.391 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jwt. 2024-09-16T14:35:09.406 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-16T14:35:09.450 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-16T14:35:09.488 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-09-16T14:35:09.505 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-16T14:35:09.546 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-16T14:35:09.777 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-attr. 2024-09-16T14:35:09.793 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-09-16T14:35:09.834 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-16T14:35:09.865 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-16T14:35:09.881 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-16T14:35:09.924 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-16T14:35:10.198 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pluggy. 2024-09-16T14:35:10.214 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-09-16T14:35:10.218 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-packaging. 2024-09-16T14:35:10.238 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-16T14:35:10.289 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-16T14:35:10.293 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-16T14:35:10.584 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-py. 2024-09-16T14:35:10.596 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T14:35:10.603 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-16T14:35:10.612 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-16T14:35:10.642 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-16T14:35:10.654 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-16T14:35:10.957 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T14:35:10.973 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-16T14:35:10.986 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-16T14:35:11.006 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-16T14:35:11.015 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-16T14:35:11.044 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-16T14:35:11.347 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-packaging. 2024-09-16T14:35:11.364 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-09-16T14:35:11.377 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T14:35:11.395 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T14:35:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-16T14:35:11.443 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T14:35:11.704 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-underscore. 2024-09-16T14:35:11.722 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-16T14:35:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-16T14:35:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-16T14:35:11.762 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-16T14:35:11.783 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-16T14:35:12.048 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-16T14:35:12.066 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-16T14:35:12.085 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pytest. 2024-09-16T14:35:12.101 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-09-16T14:35:12.106 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-16T14:35:12.143 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-16T14:35:12.427 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-09-16T14:35:12.444 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-16T14:35:12.485 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-16T14:35:12.497 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-16T14:35:12.513 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-09-16T14:35:12.555 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-16T14:35:12.808 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjs-underscore. 2024-09-16T14:35:12.824 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-16T14:35:12.830 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T14:35:12.849 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:12.866 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-16T14:35:12.888 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:13.169 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-16T14:35:13.187 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-16T14:35:13.227 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-16T14:35:13.547 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-routes. 2024-09-16T14:35:13.562 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-09-16T14:35:13.630 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-16T14:35:13.958 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-16T14:35:13.974 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:14.016 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:14.310 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-decorator. 2024-09-16T14:35:14.333 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-16T14:35:14.368 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-16T14:35:14.654 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-16T14:35:14.674 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-16T14:35:14.712 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-16T14:35:15.015 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-scipy. 2024-09-16T14:35:15.034 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-16T14:35:15.090 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-16T14:35:15.429 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-decorator. 2024-09-16T14:35:15.445 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-16T14:35:15.487 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-16T14:35:15.807 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-16T14:35:15.827 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-16T14:35:15.865 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-16T14:35:16.177 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-scipy. 2024-09-16T14:35:16.193 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-16T14:35:16.234 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-16T14:35:16.357 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-16T14:35:16.375 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-16T14:35:16.415 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-16T14:35:16.969 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T14:35:16.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-16T14:35:17.019 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-16T14:35:17.398 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T14:35:17.414 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-16T14:35:17.455 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-16T14:35:17.484 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-16T14:35:17.501 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-16T14:35:17.542 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-16T14:35:18.096 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-joblib. 2024-09-16T14:35:18.114 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T14:35:18.115 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-09-16T14:35:18.134 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:18.154 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-16T14:35:18.172 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:18.533 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn. 2024-09-16T14:35:18.549 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-16T14:35:18.590 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-16T14:35:19.300 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T14:35:19.319 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-16T14:35:19.367 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-16T14:35:19.724 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-16T14:35:19.742 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:19.782 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:20.054 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T14:35:20.074 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-16T14:35:20.112 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-16T14:35:20.449 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T14:35:20.465 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-16T14:35:20.507 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-16T14:35:20.836 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cachetools. 2024-09-16T14:35:20.856 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-09-16T14:35:20.888 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-16T14:35:20.923 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T14:35:20.942 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-16T14:35:20.980 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-16T14:35:21.163 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-16T14:35:21.184 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-16T14:35:21.222 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-16T14:35:21.293 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T14:35:21.309 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-16T14:35:21.351 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-16T14:35:21.550 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-16T14:35:21.568 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-16T14:35:21.608 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-16T14:35:21.672 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-blinker. 2024-09-16T14:35:21.690 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-16T14:35:21.730 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-16T14:35:22.033 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-16T14:35:22.050 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-16T14:35:22.055 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rsa. 2024-09-16T14:35:22.075 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-09-16T14:35:22.093 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-16T14:35:22.113 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-16T14:35:22.442 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-google-auth. 2024-09-16T14:35:22.449 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T14:35:22.458 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-09-16T14:35:22.467 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-16T14:35:22.500 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-16T14:35:22.507 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-16T14:35:22.802 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T14:35:22.808 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-blinker. 2024-09-16T14:35:22.822 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-16T14:35:22.828 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-16T14:35:22.860 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-16T14:35:22.865 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-16T14:35:23.185 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-16T14:35:23.197 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T14:35:23.202 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-16T14:35:23.213 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-16T14:35:23.243 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-16T14:35:23.255 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-16T14:35:23.555 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-16T14:35:23.573 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-16T14:35:23.622 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-16T14:35:23.818 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T14:35:23.836 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:23.877 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:23.941 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-websocket. 2024-09-16T14:35:23.960 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-16T14:35:23.999 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-16T14:35:24.230 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T14:35:24.248 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-16T14:35:24.288 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-16T14:35:24.294 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-16T14:35:24.312 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-16T14:35:24.353 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-16T14:35:24.641 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T14:35:24.659 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-16T14:35:24.717 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:35:24.925 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-16T14:35:24.942 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:24.983 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:24.998 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-09-16T14:35:25.015 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-16T14:35:25.056 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:35:25.309 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-09-16T14:35:25.325 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-16T14:35:25.330 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-16T14:35:25.349 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-09-16T14:35:25.367 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-16T14:35:25.388 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-16T14:35:25.721 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T14:35:25.742 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-16T14:35:25.767 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-16T14:35:25.779 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-16T14:35:25.784 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-16T14:35:25.825 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:35:26.087 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package jq. 2024-09-16T14:35:26.108 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-16T14:35:26.144 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-09-16T14:35:26.146 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:35:26.160 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-ceph-test_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:26.202 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:26.432 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package socat. 2024-09-16T14:35:26.452 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-09-16T14:35:26.490 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-16T14:35:26.785 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package xmlstarlet. 2024-09-16T14:35:26.801 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-16T14:35:26.843 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-16T14:35:27.197 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-test. 2024-09-16T14:35:27.214 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../094-ceph-test_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:27.255 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T14:35:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:30.489 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:30.760 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-16T14:35:30.779 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-16T14:35:30.818 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:31.330 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T14:35:31.350 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:31.359 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-volume. 2024-09-16T14:35:31.379 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../095-ceph-volume_18.2.4-845-ge4e227b3-1focal_all.deb ... 2024-09-16T14:35:31.388 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:31.417 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:31.696 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-16T14:35:31.712 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-16T14:35:31.753 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:31.774 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T14:35:31.792 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-16T14:35:31.850 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-16T14:35:32.196 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T14:35:32.214 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-16T14:35:32.254 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-16T14:35:32.274 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-16T14:35:32.292 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:32.332 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:32.615 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-16T14:35:32.634 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-16T14:35:32.673 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:32.727 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package nvme-cli. 2024-09-16T14:35:32.747 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-16T14:35:32.803 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-16T14:35:33.115 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-16T14:35:33.135 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-16T14:35:33.173 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-16T14:35:33.561 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-16T14:35:33.580 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-16T14:35:33.619 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:34.261 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-16T14:35:34.282 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-16T14:35:34.319 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-16T14:35:34.672 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webencodings. 2024-09-16T14:35:34.689 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-16T14:35:34.730 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-16T14:35:35.091 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-html5lib. 2024-09-16T14:35:35.111 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-16T14:35:35.183 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-16T14:35:35.375 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-16T14:35:35.394 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-16T14:35:35.434 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-16T14:35:35.544 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-16T14:35:35.561 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-16T14:35:35.602 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-16T14:35:35.761 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webencodings. 2024-09-16T14:35:35.778 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-16T14:35:35.819 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-16T14:35:36.075 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T14:35:36.095 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T14:35:36.139 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T14:35:36.147 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-html5lib. 2024-09-16T14:35:36.165 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-09-16T14:35:36.205 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-16T14:35:36.442 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T14:35:36.459 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-16T14:35:36.500 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-16T14:35:36.558 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-16T14:35:36.575 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-16T14:35:36.633 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-16T14:35:36.828 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T14:35:36.845 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-16T14:35:36.911 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-16T14:35:37.094 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastescript. 2024-09-16T14:35:37.111 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-09-16T14:35:37.152 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-16T14:35:37.214 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T14:35:37.233 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-16T14:35:37.281 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-16T14:35:37.506 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-psutil. 2024-09-16T14:35:37.523 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-16T14:35:37.564 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-16T14:35:37.575 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T14:35:37.593 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-16T14:35:37.633 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-16T14:35:37.884 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-16T14:35:37.904 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-16T14:35:37.975 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-16T14:35:38.269 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplejson. 2024-09-16T14:35:38.288 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-16T14:35:38.303 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-09-16T14:35:38.319 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-16T14:35:38.321 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-radosgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:38.362 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:38.580 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-16T14:35:38.600 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-16T14:35:38.647 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-16T14:35:39.346 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package radosgw. 2024-09-16T14:35:39.368 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../110-radosgw_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:39.404 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:39.801 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T14:35:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:39.859 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:40.211 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-16T14:35:40.498 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-16T14:35:40.624 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-16T14:35:40.750 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-16T14:35:40.824 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-fuse. 2024-09-16T14:35:40.842 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../111-rbd-fuse_18.2.4-845-ge4e227b3-1focal_amd64.deb ... 2024-09-16T14:35:40.882 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:40.976 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:41.185 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-16T14:35:41.495 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-16T14:35:41.511 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-09-16T14:35:41.621 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-16T14:35:41.702 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:41.747 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-16T14:35:41.827 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-16T14:35:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:42.171 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T14:35:42.497 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:42.519 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user cephadm....done 2024-09-16T14:35:42.623 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-16T14:35:42.700 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:42.758 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-16T14:35:42.833 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-16T14:35:43.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-16T14:35:43.185 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-16T14:35:43.469 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-16T14:35:43.478 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-16T14:35:43.595 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-16T14:35:43.722 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-16T14:35:43.764 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-16T14:35:44.049 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-16T14:35:44.082 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-16T14:35:44.367 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-16T14:35:44.501 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-16T14:35:44.659 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:44.802 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-16T14:35:44.960 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-16T14:35:45.078 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-16T14:35:45.086 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-16T14:35:45.338 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-16T14:35:45.362 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-16T14:35:45.638 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-16T14:35:45.655 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-argparse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:45.806 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-16T14:35:45.956 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-16T14:35:46.107 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-16T14:35:46.182 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-16T14:35:46.408 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-16T14:35:46.475 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-16T14:35:46.693 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-16T14:35:46.784 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-16T14:35:46.852 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-16T14:35:47.136 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-16T14:35:47.236 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-16T14:35:47.428 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-16T14:35:47.538 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-16T14:35:47.754 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-16T14:35:47.814 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-16T14:35:48.039 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-16T14:35:48.148 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-16T14:35:48.365 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-16T14:35:48.441 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-16T14:35:48.491 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-16T14:35:48.617 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-16T14:35:48.792 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-16T14:35:48.901 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-16T14:35:49.101 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-16T14:35:49.320 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-16T14:35:49.425 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-16T14:35:49.553 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-16T14:35:49.679 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-16T14:35:49.679 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-16T14:35:49.963 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-16T14:35:50.050 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-16T14:35:50.176 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:50.606 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-16T14:35:50.786 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:35:50.920 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-16T14:35:50.974 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-16T14:35:51.288 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-16T14:35:51.335 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-16T14:35:51.439 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-16T14:35:51.477 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:35:51.565 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-16T14:35:51.803 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:35:51.850 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-16T14:35:51.938 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-16T14:35:52.176 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:35:52.289 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-16T14:35:52.302 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-16T14:35:52.415 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-16T14:35:52.428 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-16T14:35:52.541 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-16T14:35:52.763 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-16T14:35:52.859 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-16T14:35:53.048 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-16T14:35:53.176 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:35:53.302 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-16T14:35:53.340 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-16T14:35:53.428 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-16T14:35:53.466 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:35:53.742 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-16T14:35:53.772 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-16T14:35:54.039 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-16T14:35:54.052 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-16T14:35:54.336 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-16T14:35:54.357 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-16T14:35:54.483 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-16T14:35:54.703 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-16T14:35:54.798 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-16T14:35:54.964 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-16T14:35:55.085 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-16T14:35:55.090 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-16T14:35:55.386 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-16T14:35:55.417 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-16T14:35:55.785 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-16T14:35:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-16T14:35:55.902 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-16T14:35:56.004 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-16T14:35:56.047 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-16T14:35:56.207 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-16T14:35:56.331 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-16T14:35:56.524 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-16T14:35:56.623 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-16T14:35:56.876 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-16T14:35:57.002 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-16T14:35:57.128 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-16T14:35:57.454 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-16T14:35:57.772 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-16T14:35:58.079 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:35:58.188 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-16T14:35:58.548 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-16T14:35:58.858 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-16T14:35:59.151 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:35:59.236 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:35:59.277 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-16T14:35:59.361 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-16T14:35:59.620 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-16T14:35:59.713 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-16T14:35:59.930 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-16T14:35:59.997 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-16T14:36:00.290 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-16T14:36:00.306 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-16T14:36:00.416 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-16T14:36:00.641 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-16T14:36:00.759 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-16T14:36:01.111 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-16T14:36:01.487 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-16T14:36:01.672 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-16T14:36:01.823 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-16T14:36:01.847 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-16T14:36:01.949 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:36:02.075 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-16T14:36:02.377 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-16T14:36:02.495 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-16T14:36:02.796 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-16T14:36:02.919 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-16T14:36:03.045 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-16T14:36:03.080 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T14:36:03.170 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-16T14:36:03.296 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-16T14:36:03.406 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-16T14:36:03.598 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-16T14:36:03.724 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-16T14:36:03.759 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:03.885 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-16T14:36:04.003 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:04.016 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-16T14:36:04.104 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:04.301 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-16T14:36:04.332 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:04.467 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-16T14:36:04.603 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-16T14:36:04.768 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:04.894 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-16T14:36:04.954 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librados2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.080 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-16T14:36:05.206 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librgw2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.221 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.322 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.332 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-mod-ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.448 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.578 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs2 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:05.693 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:36:05.693 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:36:05.703 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-16T14:36:05.996 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libradosstriper1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:06.122 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-16T14:36:06.133 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:06.259 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:06.385 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-16T14:36:06.440 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librbd1 (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:06.566 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-modules-core (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:06.693 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:06.905 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:36:06.905 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-16T14:36:07.323 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:07.369 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs-dev (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:07.482 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:07.495 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rados (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:07.608 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:07.638 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-16T14:36:07.734 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:07.860 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:08.488 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-09-16T14:36:08.575 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rbd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:08.701 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-fuse (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:08.827 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:08.923 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-09-16T14:36:08.978 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cephfs (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:09.104 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-common (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:09.117 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-09-16T14:36:09.138 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T14:36:09.300 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T14:36:09.632 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T14:36:09.656 INFO:teuthology.orchestra.run.smithi177.stdout:Adding group ceph....done 2024-09-16T14:36:10.016 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user ceph....done 2024-09-16T14:36:10.096 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:10.159 INFO:teuthology.orchestra.run.smithi177.stdout:Setting system user ceph properties....done 2024-09-16T14:36:10.178 INFO:teuthology.orchestra.run.smithi177.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-16T14:36:10.255 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:10.322 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-16T14:36:10.640 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-16T14:36:10.737 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:36:10.737 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:36:11.105 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-test (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:11.231 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up radosgw (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:11.372 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:36:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-16T14:36:11.756 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T14:36:12.149 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-base (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:12.214 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:12.453 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:36:12.454 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:36:12.572 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-16T14:36:12.887 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:13.010 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mds (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:13.140 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:36:13.140 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:36:13.243 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:36:13.243 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-16T14:36:13.597 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:36:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-16T14:36:14.082 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:36:14.082 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:36:14.371 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-osd (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:14.532 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:14.700 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:14.842 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:14.860 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:36:14.861 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-16T14:36:15.068 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:36:15.068 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:36:15.314 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-k8sevents (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:15.440 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:15.510 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:15.582 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mon (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:15.653 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:15.779 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:15.852 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:36:15.853 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-16T14:36:15.922 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:16.318 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-cephadm (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:16.401 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-16T14:36:16.452 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:16.578 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-dashboard (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:16.720 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-16T14:36:16.721 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-volume (18.2.4-845-ge4e227b3-1focal) ... 2024-09-16T14:36:17.013 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-16T14:36:17.082 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-16T14:36:17.234 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-16T14:36:17.518 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-16T14:36:19.882 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-16T14:36:20.412 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-16T14:36:20.515 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T14:36:20.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-09-16T14:36:20.596 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-09-16T14:36:20.821 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-09-16T14:36:20.822 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-09-16T14:36:20.991 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T14:36:20.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-09-16T14:36:21.035 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:36:21.036 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-16T14:36:21.037 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:36:21.037 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-09-16T14:36:21.038 INFO:teuthology.orchestra.run.smithi073.stdout: libsqlite3-0 2024-09-16T14:36:21.040 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-09-16T14:36:21.040 INFO:teuthology.orchestra.run.smithi073.stdout: sqlite3-doc 2024-09-16T14:36:21.069 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-09-16T14:36:21.077 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-09-16T14:36:21.077 INFO:teuthology.orchestra.run.smithi073.stdout: sqlite3 2024-09-16T14:36:21.079 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-09-16T14:36:21.080 INFO:teuthology.orchestra.run.smithi073.stdout: libsqlite3-0 2024-09-16T14:36:21.265 INFO:teuthology.orchestra.run.smithi073.stdout:1 upgraded, 1 newly installed, 0 to remove and 294 not upgraded. 2024-09-16T14:36:21.266 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 1,409 kB of archives. 2024-09-16T14:36:21.266 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 2,803 kB of additional disk space will be used. 2024-09-16T14:36:21.266 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.6 [549 kB] 2024-09-16T14:36:21.290 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-09-16T14:36:21.291 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-09-16T14:36:21.509 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-09-16T14:36:21.510 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-16T14:36:21.510 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-16T14:36:21.511 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-09-16T14:36:21.512 INFO:teuthology.orchestra.run.smithi177.stdout: libsqlite3-0 2024-09-16T14:36:21.513 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-09-16T14:36:21.513 INFO:teuthology.orchestra.run.smithi177.stdout: sqlite3-doc 2024-09-16T14:36:21.551 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-09-16T14:36:21.551 INFO:teuthology.orchestra.run.smithi177.stdout: sqlite3 2024-09-16T14:36:21.552 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2024-09-16T14:36:21.553 INFO:teuthology.orchestra.run.smithi177.stdout: libsqlite3-0 2024-09-16T14:36:21.611 INFO:teuthology.orchestra.run.smithi177.stdout:1 upgraded, 1 newly installed, 0 to remove and 294 not upgraded. 2024-09-16T14:36:21.611 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 1,409 kB of archives. 2024-09-16T14:36:21.611 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 2,803 kB of additional disk space will be used. 2024-09-16T14:36:21.611 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.6 [549 kB] 2024-09-16T14:36:21.729 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.6 [860 kB] 2024-09-16T14:36:21.817 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.6 [860 kB] 2024-09-16T14:36:22.133 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 1,409 kB in 0s (7,430 kB/s) 2024-09-16T14:36:22.306 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 1,409 kB in 1s (1,676 kB/s) 2024-09-16T14:36:22.387 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153022 files and directories currently installed.) 2024-09-16T14:36:22.391 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libsqlite3-0_3.31.1-4ubuntu0.6_amd64.deb ... 2024-09-16T14:36:22.540 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153022 files and directories currently installed.) 2024-09-16T14:36:22.544 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libsqlite3-0_3.31.1-4ubuntu0.6_amd64.deb ... 2024-09-16T14:36:22.567 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.6) over (3.31.1-4ubuntu0.3) ... 2024-09-16T14:36:22.745 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.6) over (3.31.1-4ubuntu0.3) ... 2024-09-16T14:36:22.912 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package sqlite3. 2024-09-16T14:36:22.932 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../sqlite3_3.31.1-4ubuntu0.6_amd64.deb ... 2024-09-16T14:36:22.970 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.6) ... 2024-09-16T14:36:23.099 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package sqlite3. 2024-09-16T14:36:23.118 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../sqlite3_3.31.1-4ubuntu0.6_amd64.deb ... 2024-09-16T14:36:23.158 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.6) ... 2024-09-16T14:36:23.381 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.6) ... 2024-09-16T14:36:23.508 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.6) ... 2024-09-16T14:36:23.584 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.6) ... 2024-09-16T14:36:23.635 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-16T14:36:23.712 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.6) ... 2024-09-16T14:36:23.839 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-16T14:36:24.104 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-16T14:36:24.334 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-16T14:36:24.559 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T14:36:24.564 DEBUG:teuthology.parallel:result is None 2024-09-16T14:36:24.793 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-16T14:36:24.798 DEBUG:teuthology.parallel:result is None 2024-09-16T14:36:24.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:36:24.942 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-09-16T14:36:24.965 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.4-845-ge4e227b3-1focal 2024-09-16T14:36:24.966 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1focal 2024-09-16T14:36:24.966 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1focal is installed. 2024-09-16T14:36:24.968 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e4e227b37858f5109138494e01e5ba1ba7b8ffe8 2024-09-16T14:36:25.108 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-query -W -f '${Version}' ceph 2024-09-16T14:36:25.131 INFO:teuthology.orchestra.run.smithi177.stdout:18.2.4-845-ge4e227b3-1focal 2024-09-16T14:36:25.131 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-845-ge4e227b3-1focal 2024-09-16T14:36:25.131 INFO:teuthology.task.install:The correct ceph version 18.2.4-845-ge4e227b3-1focal is installed. 2024-09-16T14:36:25.133 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T14:36:25.133 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:25.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T14:36:25.151 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:25.151 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T14:36:25.188 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T14:36:25.188 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:25.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T14:36:25.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T14:36:25.218 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:25.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T14:36:25.233 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T14:36:25.243 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T14:36:25.243 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:25.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T14:36:25.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T14:36:25.315 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:25.315 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T14:36:25.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T14:36:25.343 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T14:36:25.343 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:25.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T14:36:25.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T14:36:25.370 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:25.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T14:36:25.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T14:36:25.416 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T14:36:25.495 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T14:36:25.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-16T14:36:25.497 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-09-16T14:36:25.513 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T14:36:25.513 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T14:36:25.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T14:36:25.572 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T14:36:25.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T14:36:25.574 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T14:36:25.599 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T14:36:25.599 INFO:tasks.ceph:config {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-16T14:36:25.599 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742', 'branch': 'reef', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906742', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'mon_bind_msgr2': False, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 931, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1390, 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8', 'sleep_before_teardown': 0, 'subset': '5319/100000', 'suite': 'rados', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ae7f37330c1a72493684eb1fcaed6f2a01195bb6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'e4e227b37858f5109138494e01e5ba1ba7b8ffe8'}}, {'ceph': None}, {'exec': {'client.0': ['ceph osd pool create cephsqlite', "ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring"]}}, {'exec': {'client.0': ['ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr']}}, {'workunit': {'clients': {'client.0': ['rados/test_libcephsqlite.sh cephsqlite']}, 'env': {'CEPH_ARGS': '--id libcephsqlite --no-log-to-stderr'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_22:00:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T14:36:25.600 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T14:36:25.602 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T14:36:25.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T14:36:25.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T14:36:25.649 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:25.649 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T14:36:25.694 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T14:36:25.694 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-16T14:36:25.701 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T14:36:25.701 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:25.701 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-09-16T14:36:25.701 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:25.701 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 14:32:50.152650693 +0000 2024-09-16T14:36:25.702 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 14:32:49.944655489 +0000 2024-09-16T14:36:25.702 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 14:32:49.944655489 +0000 2024-09-16T14:36:25.702 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T14:36:25.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T14:36:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T14:36:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T14:36:25.715 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000407428 s, 1.3 MB/s 2024-09-16T14:36:25.716 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T14:36:25.724 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 14:32:50.580640820 +0000 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 14:32:50.388645249 +0000 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 14:32:50.388645249 +0000 2024-09-16T14:36:25.730 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T14:36:25.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T14:36:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T14:36:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T14:36:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000356084 s, 1.4 MB/s 2024-09-16T14:36:25.744 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T14:36:25.800 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-16T14:36:25.807 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T14:36:25.807 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:25.808 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 383 Links: 1 2024-09-16T14:36:25.808 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:25.808 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 14:32:50.804635652 +0000 2024-09-16T14:36:25.808 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 14:32:50.800635745 +0000 2024-09-16T14:36:25.808 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 14:32:50.800635745 +0000 2024-09-16T14:36:25.808 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T14:36:25.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T14:36:25.822 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T14:36:25.822 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T14:36:25.822 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000399261 s, 1.3 MB/s 2024-09-16T14:36:25.823 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T14:36:25.872 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-16T14:36:25.879 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T14:36:25.879 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:25.879 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 388 Links: 1 2024-09-16T14:36:25.879 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:25.880 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-16 14:32:51.448620798 +0000 2024-09-16T14:36:25.880 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-16 14:32:51.244625502 +0000 2024-09-16T14:36:25.880 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-16 14:32:51.244625502 +0000 2024-09-16T14:36:25.880 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-09-16T14:36:25.880 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T14:36:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-16T14:36:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-16T14:36:25.895 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000371195 s, 1.4 MB/s 2024-09-16T14:36:25.896 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T14:36:25.948 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:25.948 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:25.949 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T14:36:25.955 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T14:36:25.955 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-09-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-09-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 14:32:54.415242933 +0000 2024-09-16T14:36:26.004 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 14:32:54.195248004 +0000 2024-09-16T14:36:26.005 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 14:32:54.195248004 +0000 2024-09-16T14:36:26.005 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-09-16T14:36:26.005 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T14:36:26.017 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T14:36:26.018 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T14:36:26.018 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00046765 s, 1.1 MB/s 2024-09-16T14:36:26.019 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T14:36:26.029 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 14:32:54.635237862 +0000 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 14:32:54.631237956 +0000 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 14:32:54.631237956 +0000 2024-09-16T14:36:26.080 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-09-16T14:36:26.081 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T14:36:26.095 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T14:36:26.096 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T14:36:26.096 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000400131 s, 1.3 MB/s 2024-09-16T14:36:26.097 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T14:36:26.105 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 372 Links: 1 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 14:32:55.039228550 +0000 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 14:32:55.035228644 +0000 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 14:32:55.035228644 +0000 2024-09-16T14:36:26.156 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-09-16T14:36:26.156 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T14:36:26.169 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T14:36:26.169 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T14:36:26.169 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000405501 s, 1.3 MB/s 2024-09-16T14:36:26.170 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T14:36:26.177 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-09-16 14:32:55.675213892 +0000 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-09-16 14:32:55.475218500 +0000 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-09-16 14:32:55.475218500 +0000 2024-09-16T14:36:26.185 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2024-09-16T14:36:26.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T14:36:26.197 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-09-16T14:36:26.197 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-09-16T14:36:26.197 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000307099 s, 1.7 MB/s 2024-09-16T14:36:26.198 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T14:36:26.249 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:26.249 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T14:36:26.250 INFO:tasks.ceph:Generating config... 2024-09-16T14:36:26.251 INFO:tasks.ceph:[client] debug cephsqlite = 20 2024-09-16T14:36:26.251 INFO:tasks.ceph:[client] debug client = 20 2024-09-16T14:36:26.251 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T14:36:26.251 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-16T14:36:26.251 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-09-16T14:36:26.251 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-16T14:36:26.251 INFO:tasks.ceph:[global] ms inject socket failures = 1500 2024-09-16T14:36:26.251 INFO:tasks.ceph:[global] ms type = async 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-16T14:36:26.252 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-16T14:36:26.252 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T14:36:26.252 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-16T14:36:26.253 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T14:36:26.254 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-16T14:36:26.254 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-16T14:36:26.254 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T14:36:26.254 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-16T14:36:26.254 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-16T14:36:26.254 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-16T14:36:26.254 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T14:36:26.254 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T14:36:26.295 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T14:36:26.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T14:36:26.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T14:36:26.407 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.73:6789]'), ('mon.c', '[v1:172.21.15.73:6790]'), ('mon.b', '[v1:172.21.15.177:6789]')] 2024-09-16T14:36:26.408 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.73:6789],[v1:172.21.15.73:6790],[v1:172.21.15.177:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-16T14:36:26.409 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:26.409 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T14:36:26.414 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.73:6789]' --addv c '[v1:172.21.15.73:6790]' --addv b '[v1:172.21.15.177:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:26.500 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:26.500 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 00a48c31-0009-4414-a6e8-5009f0ad4af8 2024-09-16T14:36:26.500 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 00a48c31-0009-4414-a6e8-5009f0ad4af8 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-09-16T14:36:26.499932+0000 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-09-16T14:36:26.499932+0000 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:0: v1:172.21.15.73:6789/0 mon.a 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:1: v1:172.21.15.177:6789/0 mon.b 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:2: v1:172.21.15.73:6790/0 mon.c 2024-09-16T14:36:26.501 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T14:36:26.502 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T14:36:26.508 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 00a48c31-0009-4414-a6e8-5009f0ad4af8... 2024-09-16T14:36:26.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T14:36:26.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T14:36:26.539 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-16T14:36:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "[v1:172.21.15.73:6789],[v1:172.21.15.73:6790],[v1:172.21.15.177:6789]" 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: mon election default strategy = 1 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: ms bind msgr2 = False 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 1500 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: ms type = async 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 00a48c31-0009-4414-a6e8-5009f0ad4af8 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-16T14:36:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-16T14:36:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = snappy 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore zero block detection = True 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify cached snaps = True 2024-09-16T14:36:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify missing on start = True 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock override recovery settings = True 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue = debug_random 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue cut off = debug_random 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: osd shutdown pgref assert = True 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-16T14:36:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-16T14:36:26.548 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon min osdmap epochs = 50 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon osdmap full prune interval = 2 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon osdmap full prune min = 15 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon osdmap full prune txsize = 2 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon scrub interval = 300 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: paxos service trim min = 10 2024-09-16T14:36:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:36:26.551 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-16T14:36:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-16T14:36:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout: debug cephsqlite = 20 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-16T14:36:26.552 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-16T14:36:26.553 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-09-16T14:36:26.553 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-09-16T14:36:26.553 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T14:36:26.553 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-09-16T14:36:26.553 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.553 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-09-16T14:36:26.554 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-09-16T14:36:26.556 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "[v1:172.21.15.73:6789],[v1:172.21.15.73:6790],[v1:172.21.15.177:6789]" 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: mon client directed command retry = 5 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: mon election default strategy = 1 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: ms bind msgr2 = False 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: ms inject socket failures = 1500 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: ms type = async 2024-09-16T14:36:26.557 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 00a48c31-0009-4414-a6e8-5009f0ad4af8 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-09-16T14:36:26.558 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-09-16T14:36:26.559 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore compression algorithm = snappy 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore compression mode = aggressive 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore zero block detection = True 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 20 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 20 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 10 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T14:36:26.560 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify cached snaps = True 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify missing on start = True 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock override recovery settings = True 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd op queue = debug_random 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd op queue cut off = debug_random 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: osd shutdown pgref assert = True 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-09-16T14:36:26.561 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-09-16T14:36:26.562 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T14:36:26.563 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon min osdmap epochs = 50 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon osdmap full prune interval = 2 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon osdmap full prune min = 15 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon osdmap full prune txsize = 2 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon scrub interval = 300 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: paxos service trim min = 10 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-09-16T14:36:26.564 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: debug cephsqlite = 20 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-09-16T14:36:26.565 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-09-16T14:36:26.567 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T14:36:26.567 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T14:36:26.661 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T14:36:26.662 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:26.662 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T14:36:26.668 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:26.669 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T14:36:26.675 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:36:26.675 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:26.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T14:36:26.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T14:36:26.698 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:26.698 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:26.747 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:36:26.747 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:26.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T14:36:26.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T14:36:26.773 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:26.774 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:26.824 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T14:36:26.824 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T14:36:26.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T14:36:26.879 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T14:36:26.882 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T14:36:26.931 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T14:36:26.945 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T14:36:26.946 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T14:36:26.946 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T14:36:26.988 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T14:36:27.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T14:36:27.043 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T14:36:27.057 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T14:36:27.058 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T14:36:27.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T14:36:27.075 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:27.075 INFO:tasks.ceph:role: osd.0 2024-09-16T14:36:27.075 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:36:27.075 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T14:36:27.637 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:27.638 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:27.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T14:36:27.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T14:36:27.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T14:36:27.757 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:27.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:27.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T14:36:27.816 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:27.816 INFO:tasks.ceph:role: osd.1 2024-09-16T14:36:27.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:36:27.816 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:28.341 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:28.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T14:36:28.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T14:36:28.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T14:36:28.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:28.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T14:36:28.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:28.400 INFO:tasks.ceph:role: osd.2 2024-09-16T14:36:28.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:36:28.400 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:28.936 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:28.937 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:28.937 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:28.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T14:36:28.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T14:36:29.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T14:36:29.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:29.013 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:29.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T14:36:29.023 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:29.024 INFO:tasks.ceph:role: osd.3 2024-09-16T14:36:29.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:36:29.024 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T14:36:29.543 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:29.543 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:29.543 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:29.543 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2024-09-16T14:36:29.543 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:29.544 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:29.544 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:29.544 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:29.544 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:29.544 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:29.545 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-16T14:36:29.546 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-16T14:36:29.615 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T14:36:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:29.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:29.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:29.691+0000 7f8d63953880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T14:36:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:29.691+0000 7f8d63953880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T14:36:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:29.691+0000 7f8d63953880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T14:36:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:29.691+0000 7f8d63953880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T14:36:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:29.691+0000 7f8d63953880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-16T14:36:29.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:29.699+0000 7f8d63953880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T14:36:32.732 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T14:36:32.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:32.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:32.835+0000 7f3871a16880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T14:36:32.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:32.835+0000 7f3871a16880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T14:36:32.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:32.835+0000 7f3871a16880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T14:36:32.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:32.835+0000 7f3871a16880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T14:36:32.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:32.835+0000 7f3871a16880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-16T14:36:32.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:32.839+0000 7f3871a16880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T14:36:35.847 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T14:36:35.864 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:35.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:35.907+0000 7f32e77bc880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T14:36:35.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:35.907+0000 7f32e77bc880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T14:36:35.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:35.907+0000 7f32e77bc880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T14:36:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:35.907+0000 7f32e77bc880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T14:36:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:35.907+0000 7f32e77bc880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-16T14:36:35.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:35.907+0000 7f32e77bc880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T14:36:38.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T14:36:38.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:39.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:39.043+0000 7f6b12a15880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T14:36:39.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:39.043+0000 7f6b12a15880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T14:36:39.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:39.043+0000 7f6b12a15880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T14:36:39.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:39.043+0000 7f6b12a15880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T14:36:39.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:39.043+0000 7f6b12a15880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-16T14:36:39.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:39.043+0000 7f6b12a15880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T14:36:42.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T14:36:42.116 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T14:36:42.132 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:42.132 INFO:tasks.ceph:role: osd.4 2024-09-16T14:36:42.133 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:36:42.133 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T14:36:42.663 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:42.663 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:42.664 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:42.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-16T14:36:42.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-16T14:36:42.763 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T14:36:42.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:42.775 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:42.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T14:36:42.830 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:42.831 INFO:tasks.ceph:role: osd.5 2024-09-16T14:36:42.831 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:36:42.831 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T14:36:43.332 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:43.332 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:43.332 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:43.332 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 2024-09-16T14:36:43.332 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:43.332 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:43.333 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:43.333 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:43.333 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:43.333 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:43.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-16T14:36:43.335 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-16T14:36:43.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T14:36:43.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:43.378 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:43.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-16T14:36:43.393 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:43.393 INFO:tasks.ceph:role: osd.6 2024-09-16T14:36:43.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:36:43.393 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T14:36:43.926 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:43.926 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:43.927 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:43.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-16T14:36:43.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-16T14:36:43.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-16T14:36:44.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:44.002 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:44.002 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-16T14:36:44.060 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T14:36:44.060 INFO:tasks.ceph:role: osd.7 2024-09-16T14:36:44.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:36:44.061 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-09-16T14:36:44.565 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T14:36:44.566 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-16T14:36:44.566 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T14:36:44.566 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T14:36:44.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-09-16T14:36:44.567 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-16T14:36:44.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-16T14:36:44.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:36:44.630 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-09-16T14:36:44.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:44.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:44.753+0000 7fccc3bdf880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T14:36:44.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:44.757+0000 7fccc3bdf880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T14:36:44.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:44.757+0000 7fccc3bdf880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-16T14:36:44.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:44.757+0000 7fccc3bdf880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-16T14:36:44.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:44.757+0000 7fccc3bdf880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-16T14:36:44.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:44.761+0000 7fccc3bdf880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T14:36:47.777 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T14:36:47.793 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:47.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:47.829+0000 7f3c838ac880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T14:36:47.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:47.829+0000 7f3c838ac880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T14:36:47.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:47.829+0000 7f3c838ac880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-16T14:36:47.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:47.829+0000 7f3c838ac880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-16T14:36:47.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:47.829+0000 7f3c838ac880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-16T14:36:47.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:47.833+0000 7f3c838ac880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T14:36:50.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T14:36:50.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:50.929+0000 7f395d190880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-16T14:36:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:50.929+0000 7f395d190880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-16T14:36:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:50.929+0000 7f395d190880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-16T14:36:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:50.929+0000 7f395d190880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-16T14:36:50.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:50.929+0000 7f395d190880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-16T14:36:50.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:50.929+0000 7f395d190880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-16T14:36:53.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-16T14:36:53.932 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:54.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:54.016+0000 7f2a224bb880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-16T14:36:54.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:54.016+0000 7f2a224bb880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-16T14:36:54.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:54.016+0000 7f2a224bb880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-16T14:36:54.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:54.016+0000 7f2a224bb880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-16T14:36:54.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:54.016+0000 7f2a224bb880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-16T14:36:54.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:36:54.016+0000 7f2a224bb880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-16T14:36:57.027 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-16T14:36:57.042 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T14:36:57.042 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:57.042 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T14:36:57.059 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:57.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T14:36:57.116 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:57.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T14:36:57.125 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:57.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T14:36:57.139 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:57.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T14:36:57.193 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:57.193 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T14:36:57.209 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:57.209 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T14:36:57.266 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:57.266 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T14:36:57.282 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:57.282 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-16T14:36:57.297 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:57.297 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-16T14:36:57.356 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:36:57.356 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T14:36:57.364 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:36:57.364 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T14:36:57.369 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T14:36:57.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T14:36:57.372 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T14:36:57.382 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2024-09-16T14:36:57.382 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBqQuhmb7JnNBAAhGD+w2LmK2uF4u8oupd1cA== 2024-09-16T14:36:57.382 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-09-16T14:36:57.382 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBtQuhmSFlZKRAAITM+Bi0FKYm7xZGnFwebMw== 2024-09-16T14:36:57.382 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBwQuhm7RUHMhAAnCr8VquHbCGjGRSCpFgIlQ== 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBzQuhm/Ow0NhAAEMKeBbJAgefWGQyH0Tittg== 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB3QuhmW++fAhAAC4ibyC8+7IIWOoJsyrQtGg== 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBqQuhmrVGLNxAA8et6sGPfSuJXnHo4Z48axQ== 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB8QuhmLbQBLRAAbpn409VtqxCbx9to/NQumQ== 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2024-09-16T14:36:57.383 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQB/Quhm0PehMRAAqBcQc4Mdlyig+p9uPe7T3Q== 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCCQuhmHu9xNxAAllkXErnd1eCskvCA3+meGQ== 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCGQuhmLuktARAA8vVtWLeZD5xqRXpWyojEvg== 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBqQuhm5ITdOhAAfl1xj/iV2ykqGsAv0QdshQ== 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2024-09-16T14:36:57.384 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBrQuhmocObAhAAwSW1rTLDJkpeXiboZd7w1w== 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBqQuhmb7JnNBAAhGD+w2LmK2uF4u8oupd1cA== 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBtQuhmSFlZKRAAITM+Bi0FKYm7xZGnFwebMw== 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwQuhm7RUHMhAAnCr8VquHbCGjGRSCpFgIlQ== 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBzQuhm/Ow0NhAAEMKeBbJAgefWGQyH0Tittg== 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB3QuhmW++fAhAAC4ibyC8+7IIWOoJsyrQtGg== 2024-09-16T14:36:57.386 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBqQuhmrVGLNxAA8et6sGPfSuJXnHo4Z48axQ== 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB8QuhmLbQBLRAAbpn409VtqxCbx9to/NQumQ== 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB/Quhm0PehMRAAqBcQc4Mdlyig+p9uPe7T3Q== 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCCQuhmHu9xNxAAllkXErnd1eCskvCA3+meGQ== 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCGQuhmLuktARAA8vVtWLeZD5xqRXpWyojEvg== 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBqQuhm5ITdOhAAfl1xj/iV2ykqGsAv0QdshQ== 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-09-16T14:36:57.387 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBrQuhmocObAhAAwSW1rTLDJkpeXiboZd7w1w== 2024-09-16T14:36:57.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T14:36:57.430 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T14:36:57.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.483 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T14:36:57.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T14:36:57.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.903 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.905 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.952 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:57.994 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:58.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:58.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T14:36:58.116 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T14:36:58.118 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T14:36:58.191 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T14:36:58.194 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T14:36:58.332 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T14:36:58.332 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T14:36:58.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T14:36:58.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T14:36:58.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T14:36:58.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T14:36:58.602 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T14:36:58.619 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T14:36:58.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T14:36:58.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T14:36:58.728 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:58.730 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T14:36:58.735 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T14:36:58.735 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T14:36:58.735 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T14:36:58.738 INFO:tasks.ceph.mon.a:Started 2024-09-16T14:36:58.738 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T14:36:58.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T14:36:58.740 INFO:tasks.ceph.mon.c:Started 2024-09-16T14:36:58.740 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T14:36:58.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T14:36:58.742 INFO:tasks.ceph.mon.b:Started 2024-09-16T14:36:58.743 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T14:36:58.743 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T14:36:58.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T14:36:58.745 INFO:tasks.ceph.mgr.y:Started 2024-09-16T14:36:58.745 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T14:36:58.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T14:36:58.749 INFO:tasks.ceph.mgr.x:Started 2024-09-16T14:36:58.749 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T14:36:58.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T14:36:58.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27b2367700 1 Processor -- start 2024-09-16T14:36:58.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27b2367700 1 -- start start 2024-09-16T14:36:58.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27b2367700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac071900 con 0x7f27ac141010 2024-09-16T14:36:58.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27b2367700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac0ad740 con 0x7f27ac0b05b0 2024-09-16T14:36:58.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27ab7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f27ac141010 0x7f27ac13a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60042/0 (socket says 172.21.15.73:60042) 2024-09-16T14:36:58.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27ab7fe700 1 -- 172.21.15.73:0/2245075706 learned_addr learned my addr 172.21.15.73:0/2245075706 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:36:58.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:36:58.866+0000 7f27b2367700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac071e20 con 0x7f27ac13ad20 2024-09-16T14:37:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:01.866+0000 7f27a9ffb700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6790/0 conn(0x7f27ac13ad20 legacy=0x7f27ac148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:01.866+0000 7f27a9ffb700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.177:6789/0 conn(0x7f27ac0b05b0 legacy=0x7f27ac140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:01.866+0000 7f27a9ffb700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6789/0 conn(0x7f27ac141010 legacy=0x7f27ac13a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:01.866+0000 7f27a9ffb700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac0728a0 con 0x7f27ac141010 2024-09-16T14:37:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:01.866+0000 7f27a9ffb700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c010530 con 0x7f27ac0b05b0 2024-09-16T14:37:01.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:01.866+0000 7f27a9ffb700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c011740 con 0x7f278c004870 2024-09-16T14:37:03.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067914930 0 0) 0x7f27ac0728a0 con 0x7f27ac141010 2024-09-16T14:37:03.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27980057e0 con 0x7f27ac141010 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421362336 0 0) 0x7f278c011740 con 0x7f278c004870 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ac0728a0 con 0x7f278c004870 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708618218 0 0) 0x7f278c010530 con 0x7f27ac0b05b0 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c011740 con 0x7f27ac0b05b0 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27abfff700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6790/0 conn(0x7f278c004870 legacy=0x7f278c006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27abfff700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6790/0 conn(0x7f278c004870 legacy=0x7f278c006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27abfff700 1 --1- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6790/0 conn(0x7f278c004870 0x7f278c006ca0 :-1 s=OPENED pgs=12 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:03.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27abfff700 1 --1- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6790/0 conn(0x7f278c004870 0x7f278c006ca0 :-1 s=OPENED pgs=12 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445669286 0 0) 0x7f27980057e0 con 0x7f27ac141010 2024-09-16T14:37:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6790/0 conn(0x7f278c004870 legacy=0x7f278c006ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.177:6789/0 conn(0x7f27ac0b05b0 legacy=0x7f278c00a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.922+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c012950 con 0x7f27ac141010 2024-09-16T14:37:03.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.926+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2794001650 con 0x7f27ac141010 2024-09-16T14:37:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.926+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2794001870 con 0x7f27ac141010 2024-09-16T14:37:03.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.926+0000 7f27aaffd700 1 -- 172.21.15.73:0/2245075706 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2794001c00 con 0x7f27ac141010 2024-09-16T14:37:03.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 -- 172.21.15.73:0/2245075706 >> v1:172.21.15.73:6789/0 conn(0x7f27ac141010 legacy=0x7f278c00dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:03.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 -- 172.21.15.73:0/2245075706 shutdown_connections 2024-09-16T14:37:03.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 -- 172.21.15.73:0/2245075706 >> 172.21.15.73:0/2245075706 conn(0x7f27ac0b3760 msgr2=0x7f27ac0afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:03.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 -- 172.21.15.73:0/2245075706 shutdown_connections 2024-09-16T14:37:03.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 -- 172.21.15.73:0/2245075706 wait complete. 2024-09-16T14:37:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 Processor -- start 2024-09-16T14:37:03.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.930+0000 7f27b2367700 1 -- start start 2024-09-16T14:37:03.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27b2367700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac0b2c80 con 0x7f278c004870 2024-09-16T14:37:03.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27b2367700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac13da00 con 0x7f27ac0b05b0 2024-09-16T14:37:03.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27b2367700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac136b20 con 0x7f27ac141010 2024-09-16T14:37:03.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27abfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f278c004870 0x7f27ac136410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:60080/0 (socket says 172.21.15.73:60080) 2024-09-16T14:37:03.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27abfff700 1 -- 172.21.15.73:0/3496787290 learned_addr learned my addr 172.21.15.73:0/3496787290 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:03.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233301387 0 0) 0x7f27ac0b2c80 con 0x7f278c004870 2024-09-16T14:37:03.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c00f870 con 0x7f278c004870 2024-09-16T14:37:03.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2644126704 0 0) 0x7f278c00f870 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27ac0b2c80 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f27a4001980 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 136558464 0 0) 0x7f27ac0b2c80 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 >> v1:172.21.15.73:6790/0 conn(0x7f27ac141010 legacy=0x7f27ac1dd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 >> v1:172.21.15.177:6789/0 conn(0x7f27ac0b05b0 legacy=0x7f27ac1d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac136cb0 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac13ca60 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac13d5e0 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f27a4001d50 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f27a4003af0 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f27a4003fd0 con 0x7f278c004870 2024-09-16T14:37:03.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.934+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 3490889675 0 0) 0x7f27a4005870 con 0x7f278c004870 2024-09-16T14:37:03.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.938+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac074a00 con 0x7f278c004870 2024-09-16T14:37:03.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:03.942+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f27a4005b00 con 0x7f278c004870 2024-09-16T14:37:04.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.018+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f27ac067870 con 0x7f278c004870 2024-09-16T14:37:04.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.018+0000 7f27a8ff9700 1 -- 172.21.15.73:0/3496787290 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (unknown 2277712955 0 0) 0x7f27a4006300 con 0x7f278c004870 2024-09-16T14:37:04.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.022+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 >> v1:172.21.15.73:6789/0 conn(0x7f278c004870 legacy=0x7f27ac136410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.022+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 shutdown_connections 2024-09-16T14:37:04.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.022+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 >> 172.21.15.73:0/3496787290 conn(0x7f27ac0b3760 msgr2=0x7f27ac066690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.022+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 shutdown_connections 2024-09-16T14:37:04.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:04.022+0000 7f27b2367700 1 -- 172.21.15.73:0/3496787290 wait complete. 2024-09-16T14:37:04.027 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-09-16T14:37:04.038 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T14:37:04.039 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T14:37:04.039 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:37:04.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T14:37:04.049 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:37:04.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T14:37:04.059 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:37:04.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T14:37:04.069 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:37:04.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T14:37:04.079 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:37:04.079 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T14:37:04.095 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:37:04.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T14:37:04.109 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:04.106+0000 7f71064072c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T14:37:04.152 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:37:04.152 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-16T14:37:04.160 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:04.156+0000 7f9b9e4332c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T14:37:04.162 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-09-16T14:37:04.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-16T14:37:04.172 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 1d48450e-baaa-42ad-93b9-30c34ec79d62 0 2024-09-16T14:37:04.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc5708d4700 1 Processor -- start 2024-09-16T14:37:04.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc5708d4700 1 -- start start 2024-09-16T14:37:04.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc5708d4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c13b070 con 0x7fc56c0b2a10 2024-09-16T14:37:04.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc5708d4700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0a9bf0 con 0x7fc56c073d10 2024-09-16T14:37:04.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc5708d4700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0a9ed0 con 0x7fc56c073930 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56affd700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc56c073d10 0x7fc56c140c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33668/0 (socket says 172.21.15.177:33668) 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56affd700 1 -- 172.21.15.177:0/3311782010 learned_addr learned my addr 172.21.15.177:0/3311782010 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044776692 0 0) 0x7fc56c0a9bf0 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5540035d0 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289932793 0 0) 0x7fc5540035d0 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 >> v1:172.21.15.73:6790/0 conn(0x7fc56c073930 legacy=0x7fc56c0b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 >> v1:172.21.15.73:6789/0 conn(0x7fc56c0b2a10 legacy=0x7fc56c14c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0b2ea0 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.324+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc55c001610 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc55c001930 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc56a7fc700 1 -- 172.21.15.177:0/3311782010 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc55c001cc0 con 0x7fc56c073d10 2024-09-16T14:37:04.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/3311782010 >> v1:172.21.15.177:6789/0 conn(0x7fc56c073d10 legacy=0x7fc56c140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/3311782010 shutdown_connections 2024-09-16T14:37:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/3311782010 >> 172.21.15.177:0/3311782010 conn(0x7fc56c0b37a0 msgr2=0x7fc56c0b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/3311782010 shutdown_connections 2024-09-16T14:37:04.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/3311782010 wait complete. 2024-09-16T14:37:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 Processor -- start 2024-09-16T14:37:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- start start 2024-09-16T14:37:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c13d960 con 0x7fc56c144e80 2024-09-16T14:37:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c140ed0 con 0x7fc56c073930 2024-09-16T14:37:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c13ce00 con 0x7fc56c140320 2024-09-16T14:37:04.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc56b7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc56c073930 0x7fc56c13d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33682/0 (socket says 172.21.15.177:33682) 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc56b7fe700 1 -- 172.21.15.177:0/894486005 learned_addr learned my addr 172.21.15.177:0/894486005 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 628680450 0 0) 0x7fc56c140ed0 con 0x7fc56c073930 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5580035d0 con 0x7fc56c073930 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176639623 0 0) 0x7fc56c13d960 con 0x7fc56c144e80 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56c140ed0 con 0x7fc56c144e80 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 23111691 0 0) 0x7fc5580035d0 con 0x7fc56c073930 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc56c13d960 con 0x7fc56c073930 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc560001970 con 0x7fc56c073930 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786135522 0 0) 0x7fc56c13ce00 con 0x7fc56c140320 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5580035d0 con 0x7fc56c140320 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3513662493 0 0) 0x7fc56c13d960 con 0x7fc56c073930 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 >> v1:172.21.15.73:6790/0 conn(0x7fc56c140320 legacy=0x7fc56c144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 >> v1:172.21.15.73:6789/0 conn(0x7fc56c144e80 legacy=0x7fc56c1d9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c1d9940 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c1d9c10 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c1e27c0 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc560001d00 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc560003b90 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7fc560004070 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.328+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (unknown 2981558365 0 0) 0x7fc560006590 con 0x7fc56c073930 2024-09-16T14:37:04.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.332+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c005100 con 0x7fc56c073930 2024-09-16T14:37:04.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.336+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7fc560005870 con 0x7fc56c073930 2024-09-16T14:37:04.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.408+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "1d48450e-baaa-42ad-93b9-30c34ec79d62", "id": 0} v 0) v1 -- 0x7fc54c005930 con 0x7fc56c073930 2024-09-16T14:37:04.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.416+0000 7fc553fff700 1 -- 172.21.15.177:0/894486005 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d48450e-baaa-42ad-93b9-30c34ec79d62", "id": 0}]=0 v3) v1 ==== 112+0+2 (unknown 4262165136 0 732707515) 0x7fc560005a90 con 0x7fc56c073930 2024-09-16T14:37:04.418 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-09-16T14:37:04.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.416+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 >> v1:172.21.15.177:6789/0 conn(0x7fc56c073930 legacy=0x7fc56c13d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.416+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 shutdown_connections 2024-09-16T14:37:04.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.416+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 >> 172.21.15.177:0/894486005 conn(0x7fc56c0b37a0 msgr2=0x7fc56c138e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.416+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 shutdown_connections 2024-09-16T14:37:04.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.416+0000 7fc5708d4700 1 -- 172.21.15.177:0/894486005 wait complete. 2024-09-16T14:37:04.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 58e40796-3999-48ed-a83f-ad57036a99c8 1 2024-09-16T14:37:04.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbea029700 1 Processor -- start 2024-09-16T14:37:04.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbea029700 1 -- start start 2024-09-16T14:37:04.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbea029700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40a7db0 con 0x7ffbe40aa880 2024-09-16T14:37:04.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbea029700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40a8090 con 0x7ffbe40aea20 2024-09-16T14:37:04.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbea029700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe4142940 con 0x7ffbe406a5d0 2024-09-16T14:37:04.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe9828700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffbe40aea20 0x7ffbe414a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33684/0 (socket says 172.21.15.177:33684) 2024-09-16T14:37:04.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe9828700 1 -- 172.21.15.177:0/1581943319 learned_addr learned my addr 172.21.15.177:0/1581943319 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126617659 0 0) 0x7ffbe40a8090 con 0x7ffbe40aea20 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbcc0035d0 con 0x7ffbe40aea20 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922980791 0 0) 0x7ffbe4142940 con 0x7ffbe406a5d0 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe40a8090 con 0x7ffbe406a5d0 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576757574 0 0) 0x7ffbe40a7db0 con 0x7ffbe40aa880 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe4142940 con 0x7ffbe40aa880 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 684753641 0 0) 0x7ffbcc0035d0 con 0x7ffbe40aea20 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 >> v1:172.21.15.73:6790/0 conn(0x7ffbe406a5d0 legacy=0x7ffbe4141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 >> v1:172.21.15.73:6789/0 conn(0x7ffbe40aa880 legacy=0x7ffbe40ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe4142610 con 0x7ffbe40aea20 2024-09-16T14:37:04.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ffbd4001610 con 0x7ffbe40aea20 2024-09-16T14:37:04.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ffbd40018f0 con 0x7ffbe40aea20 2024-09-16T14:37:04.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.544+0000 7ffbe3fff700 1 -- 172.21.15.177:0/1581943319 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ffbd4001c80 con 0x7ffbe40aea20 2024-09-16T14:37:04.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- 172.21.15.177:0/1581943319 >> v1:172.21.15.177:6789/0 conn(0x7ffbe40aea20 legacy=0x7ffbe414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- 172.21.15.177:0/1581943319 shutdown_connections 2024-09-16T14:37:04.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- 172.21.15.177:0/1581943319 >> 172.21.15.177:0/1581943319 conn(0x7ffbe40b3910 msgr2=0x7ffbe40b3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- 172.21.15.177:0/1581943319 shutdown_connections 2024-09-16T14:37:04.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- 172.21.15.177:0/1581943319 wait complete. 2024-09-16T14:37:04.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 Processor -- start 2024-09-16T14:37:04.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- start start 2024-09-16T14:37:04.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe409a6b0 con 0x7ffbe406a5d0 2024-09-16T14:37:04.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe409a8e0 con 0x7ffbe40aa880 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbea029700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40717d0 con 0x7ffbe4071fd0 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbe8826700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffbe40aa880 0x7ffbe406e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33686/0 (socket says 172.21.15.177:33686) 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.548+0000 7ffbe8826700 1 -- 172.21.15.177:0/2009221533 learned_addr learned my addr 172.21.15.177:0/2009221533 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447066633 0 0) 0x7ffbe409a8e0 con 0x7ffbe40aa880 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd00035d0 con 0x7ffbe40aa880 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090276975 0 0) 0x7ffbe409a6b0 con 0x7ffbe406a5d0 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe409a8e0 con 0x7ffbe406a5d0 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553000064 0 0) 0x7ffbe40717d0 con 0x7ffbe4071fd0 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe409a6b0 con 0x7ffbe4071fd0 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4162969673 0 0) 0x7ffbd00035d0 con 0x7ffbe40aa880 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffbe40717d0 con 0x7ffbe40aa880 2024-09-16T14:37:04.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ffbd8001990 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2585115840 0 0) 0x7ffbe40717d0 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 >> v1:172.21.15.73:6790/0 conn(0x7ffbe4071fd0 legacy=0x7ffbe41deb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 >> v1:172.21.15.73:6789/0 conn(0x7ffbe406a5d0 legacy=0x7ffbe4070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe406ec40 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40700f0 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe41e0480 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ffbd8001c70 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ffbd8003b10 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7ffbd8003f70 con 0x7ffbe40aa880 2024-09-16T14:37:04.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (unknown 2923342609 0 0) 0x7ffbd8006470 con 0x7ffbe40aa880 2024-09-16T14:37:04.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.552+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc4005100 con 0x7ffbe40aa880 2024-09-16T14:37:04.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.556+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7ffbd8004450 con 0x7ffbe40aa880 2024-09-16T14:37:04.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.632+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "58e40796-3999-48ed-a83f-ad57036a99c8", "id": 1} v 0) v1 -- 0x7ffbc4005930 con 0x7ffbe40aa880 2024-09-16T14:37:04.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.640+0000 7ffbe1ffb700 1 -- 172.21.15.177:0/2009221533 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58e40796-3999-48ed-a83f-ad57036a99c8", "id": 1}]=0 v4) v1 ==== 112+0+2 (unknown 3475858691 0 940483276) 0x7ffbd8005940 con 0x7ffbe40aa880 2024-09-16T14:37:04.643 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-09-16T14:37:04.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.640+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 >> v1:172.21.15.177:6789/0 conn(0x7ffbe40aa880 legacy=0x7ffbe406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.640+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 shutdown_connections 2024-09-16T14:37:04.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.640+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 >> 172.21.15.177:0/2009221533 conn(0x7ffbe40b3910 msgr2=0x7ffbe40b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.640+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 shutdown_connections 2024-09-16T14:37:04.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.640+0000 7ffbea029700 1 -- 172.21.15.177:0/2009221533 wait complete. 2024-09-16T14:37:04.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 53fdea0d-c928-4266-bfc7-9fbd991a9fb6 2 2024-09-16T14:37:04.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff6701fb700 1 Processor -- start 2024-09-16T14:37:04.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff6701fb700 1 -- start start 2024-09-16T14:37:04.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff6701fb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66806ea20 con 0x7ff66806e4b0 2024-09-16T14:37:04.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff6701fb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680ae0f0 con 0x7ff66806a5d0 2024-09-16T14:37:04.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff6701fb700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680ad650 con 0x7ff668142c70 2024-09-16T14:37:04.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff66df97700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff66806a5d0 0x7ff668142560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33702/0 (socket says 172.21.15.177:33702) 2024-09-16T14:37:04.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.764+0000 7ff66df97700 1 -- 172.21.15.177:0/3112587487 learned_addr learned my addr 172.21.15.177:0/3112587487 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012380098 0 0) 0x7ff6680ae0f0 con 0x7ff66806a5d0 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6540035d0 con 0x7ff66806a5d0 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706962089 0 0) 0x7ff6680ad650 con 0x7ff668142c70 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6680ae0f0 con 0x7ff668142c70 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569597027 0 0) 0x7ff66806ea20 con 0x7ff66806e4b0 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6680ad650 con 0x7ff66806e4b0 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842686557 0 0) 0x7ff6540035d0 con 0x7ff66806a5d0 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 >> v1:172.21.15.73:6790/0 conn(0x7ff668142c70 legacy=0x7ff668148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 >> v1:172.21.15.73:6789/0 conn(0x7ff66806e4b0 legacy=0x7ff668148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680ad7e0 con 0x7ff66806a5d0 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff664001610 con 0x7ff66806a5d0 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6640018f0 con 0x7ff66806a5d0 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff66cf95700 1 -- 172.21.15.177:0/3112587487 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff664001c80 con 0x7ff66806a5d0 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- 172.21.15.177:0/3112587487 >> v1:172.21.15.177:6789/0 conn(0x7ff66806a5d0 legacy=0x7ff668142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- 172.21.15.177:0/3112587487 shutdown_connections 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- 172.21.15.177:0/3112587487 >> 172.21.15.177:0/3112587487 conn(0x7ff6680b3ad0 msgr2=0x7ff6680b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- 172.21.15.177:0/3112587487 shutdown_connections 2024-09-16T14:37:04.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- 172.21.15.177:0/3112587487 wait complete. 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 Processor -- start 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- start start 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680b32c0 con 0x7ff66806a5d0 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6681438c0 con 0x7ff66806e4b0 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.768+0000 7ff6701fb700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6681deba0 con 0x7ff668142c70 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff66d796700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff66806e4b0 0x7ff6681ddd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33716/0 (socket says 172.21.15.177:33716) 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff66d796700 1 -- 172.21.15.177:0/116768277 learned_addr learned my addr 172.21.15.177:0/116768277 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669197183 0 0) 0x7ff6681438c0 con 0x7ff66806e4b0 2024-09-16T14:37:04.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff64c0035d0 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931709262 0 0) 0x7ff6680b32c0 con 0x7ff66806a5d0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6681438c0 con 0x7ff66806a5d0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275019557 0 0) 0x7ff6681deba0 con 0x7ff668142c70 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6680b32c0 con 0x7ff668142c70 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2564383762 0 0) 0x7ff64c0035d0 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff6681deba0 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff658001870 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 253502130 0 0) 0x7ff6681deba0 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 >> v1:172.21.15.73:6790/0 conn(0x7ff668142c70 legacy=0x7ff6681de490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 >> v1:172.21.15.73:6789/0 conn(0x7ff66806a5d0 legacy=0x7ff6681431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668145070 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff668145350 con 0x7ff66806e4b0 2024-09-16T14:37:04.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff6580036c0 con 0x7ff66806e4b0 2024-09-16T14:37:04.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff668143fc0 con 0x7ff66806e4b0 2024-09-16T14:37:04.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff658003a50 con 0x7ff66806e4b0 2024-09-16T14:37:04.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7ff658003f30 con 0x7ff66806e4b0 2024-09-16T14:37:04.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (unknown 3755302907 0 0) 0x7ff6580041e0 con 0x7ff66806e4b0 2024-09-16T14:37:04.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.772+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff668144270 con 0x7ff66806e4b0 2024-09-16T14:37:04.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.776+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7ff6580043f0 con 0x7ff66806e4b0 2024-09-16T14:37:04.831 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:04.826+0000 7f71064072c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T14:37:04.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.848+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "53fdea0d-c928-4266-bfc7-9fbd991a9fb6", "id": 2} v 0) v1 -- 0x7ff668142820 con 0x7ff66806e4b0 2024-09-16T14:37:04.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.860+0000 7ff65e7fc700 1 -- 172.21.15.177:0/116768277 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53fdea0d-c928-4266-bfc7-9fbd991a9fb6", "id": 2}]=0 v5) v1 ==== 112+0+2 (unknown 2327952517 0 216599125) 0x7ff658005870 con 0x7ff66806e4b0 2024-09-16T14:37:04.862 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-09-16T14:37:04.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.860+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 >> v1:172.21.15.177:6789/0 conn(0x7ff66806e4b0 legacy=0x7ff6681ddd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.860+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 shutdown_connections 2024-09-16T14:37:04.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.860+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 >> 172.21.15.177:0/116768277 conn(0x7ff6680b3ad0 msgr2=0x7ff668148f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.860+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 shutdown_connections 2024-09-16T14:37:04.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.860+0000 7ff6701fb700 1 -- 172.21.15.177:0/116768277 wait complete. 2024-09-16T14:37:04.876 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new fbf3a6da-fa7d-4901-86bd-fe8c90665a54 3 2024-09-16T14:37:04.890 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:04.886+0000 7f71064072c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T14:37:04.891 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:04.888+0000 7f9b9e4332c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T14:37:04.953 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:04.948+0000 7f9b9e4332c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T14:37:04.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaae84700 1 Processor -- start 2024-09-16T14:37:04.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaae84700 1 -- start start 2024-09-16T14:37:04.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaae84700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40706a0 con 0x7f1aa40739b0 2024-09-16T14:37:04.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaae84700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa4072130 con 0x7f1aa413c490 2024-09-16T14:37:04.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaae84700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa4072410 con 0x7f1aa4073d90 2024-09-16T14:37:04.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaa683700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1aa413c490 0x7f1aa414a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33726/0 (socket says 172.21.15.177:33726) 2024-09-16T14:37:04.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aaa683700 1 -- 172.21.15.177:0/3802230200 learned_addr learned my addr 172.21.15.177:0/3802230200 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155744581 0 0) 0x7f1aa4072130 con 0x7f1aa413c490 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a900035d0 con 0x7f1aa413c490 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049063442 0 0) 0x7f1aa40706a0 con 0x7f1aa40739b0 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa4072130 con 0x7f1aa40739b0 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972722789 0 0) 0x7f1aa4072410 con 0x7f1aa4073d90 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa40706a0 con 0x7f1aa4073d90 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2203524774 0 0) 0x7f1a900035d0 con 0x7f1aa413c490 2024-09-16T14:37:04.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 >> v1:172.21.15.73:6790/0 conn(0x7f1aa4073d90 legacy=0x7f1aa413bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 >> v1:172.21.15.73:6789/0 conn(0x7f1aa40739b0 legacy=0x7f1aa4141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4071250 con 0x7f1aa413c490 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.980+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f1a9c001990 con 0x7f1aa413c490 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1a9c001c70 con 0x7f1aa413c490 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aa8e80700 1 -- 172.21.15.177:0/3802230200 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f1a9c002000 con 0x7f1aa413c490 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- 172.21.15.177:0/3802230200 >> v1:172.21.15.177:6789/0 conn(0x7f1aa413c490 legacy=0x7f1aa414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- 172.21.15.177:0/3802230200 shutdown_connections 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- 172.21.15.177:0/3802230200 >> 172.21.15.177:0/3802230200 conn(0x7f1aa40b3170 msgr2=0x7f1aa40b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- 172.21.15.177:0/3802230200 shutdown_connections 2024-09-16T14:37:04.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- 172.21.15.177:0/3802230200 wait complete. 2024-09-16T14:37:04.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 Processor -- start 2024-09-16T14:37:04.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- start start 2024-09-16T14:37:04.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa411b380 con 0x7f1aa40aadc0 2024-09-16T14:37:04.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa411b5f0 con 0x7f1aa413c490 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aaae84700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40a9f80 con 0x7f1aa40739b0 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aa9681700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1aa413c490 0x7f1aa41d3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33738/0 (socket says 172.21.15.177:33738) 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.984+0000 7f1aa9681700 1 -- 172.21.15.177:0/613843286 learned_addr learned my addr 172.21.15.177:0/613843286 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444388903 0 0) 0x7f1aa411b5f0 con 0x7f1aa413c490 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a880035d0 con 0x7f1aa413c490 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254130655 0 0) 0x7f1aa411b380 con 0x7f1aa40aadc0 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa411b5f0 con 0x7f1aa40aadc0 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185933624 0 0) 0x7f1aa40a9f80 con 0x7f1aa40739b0 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa411b380 con 0x7f1aa40739b0 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1690927079 0 0) 0x7f1a880035d0 con 0x7f1aa413c490 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1aa40a9f80 con 0x7f1aa413c490 2024-09-16T14:37:04.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f1a94001990 con 0x7f1aa413c490 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 465925913 0 0) 0x7f1aa411b5f0 con 0x7f1aa40aadc0 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1a880035d0 con 0x7f1aa40aadc0 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f1a9c0017b0 con 0x7f1aa40aadc0 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2210335061 0 0) 0x7f1aa40a9f80 con 0x7f1aa413c490 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 >> v1:172.21.15.73:6790/0 conn(0x7f1aa40739b0 legacy=0x7f1aa4138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 >> v1:172.21.15.73:6789/0 conn(0x7f1aa40aadc0 legacy=0x7f1aa41d46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40ac000 con 0x7f1aa413c490 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa40ab990 con 0x7f1aa413c490 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4138730 con 0x7f1aa413c490 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1a94001d40 con 0x7f1aa413c490 2024-09-16T14:37:04.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f1a94003b10 con 0x7f1aa413c490 2024-09-16T14:37:04.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f1a94003ff0 con 0x7f1aa413c490 2024-09-16T14:37:04.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (unknown 1180407255 0 0) 0x7f1a940042a0 con 0x7f1aa413c490 2024-09-16T14:37:04.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.988+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c005100 con 0x7f1aa413c490 2024-09-16T14:37:04.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:04.992+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f1a94005870 con 0x7f1aa413c490 2024-09-16T14:37:05.060 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:05.058+0000 7f71064072c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T14:37:05.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.068+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "fbf3a6da-fa7d-4901-86bd-fe8c90665a54", "id": 3} v 0) v1 -- 0x7f1a8c0053b0 con 0x7f1aa413c490 2024-09-16T14:37:05.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.076+0000 7f1a9a7fc700 1 -- 172.21.15.177:0/613843286 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbf3a6da-fa7d-4901-86bd-fe8c90665a54", "id": 3}]=0 v6) v1 ==== 112+0+2 (unknown 3844067906 0 525046306) 0x7f1a94005a90 con 0x7f1aa413c490 2024-09-16T14:37:05.078 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-09-16T14:37:05.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.076+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 >> v1:172.21.15.177:6789/0 conn(0x7f1aa413c490 legacy=0x7f1aa41d3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.076+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 shutdown_connections 2024-09-16T14:37:05.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.076+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 >> 172.21.15.177:0/613843286 conn(0x7f1aa40b3170 msgr2=0x7f1aa40ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.076+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 shutdown_connections 2024-09-16T14:37:05.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.076+0000 7f1aaae84700 1 -- 172.21.15.177:0/613843286 wait complete. 2024-09-16T14:37:05.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new f493a27b-6fca-494f-9031-d13e97c866e7 4 2024-09-16T14:37:05.127 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:05.124+0000 7f9b9e4332c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T14:37:05.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.200+0000 7f6033fff700 1 Processor -- start 2024-09-16T14:37:05.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.200+0000 7f6033fff700 1 -- start start 2024-09-16T14:37:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340aeda0 con 0x7f603406a9b0 2024-09-16T14:37:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340ae9c0 con 0x7f6034071af0 2024-09-16T14:37:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340aeb50 con 0x7f603406a5d0 2024-09-16T14:37:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f60337fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6034071af0 0x7f60341496c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33740/0 (socket says 172.21.15.177:33740) 2024-09-16T14:37:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f60337fe700 1 -- 172.21.15.177:0/1145234396 learned_addr learned my addr 172.21.15.177:0/1145234396 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798275083 0 0) 0x7f60340ae9c0 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c0035d0 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912410043 0 0) 0x7f60340aeb50 con 0x7f603406a5d0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60340ae9c0 con 0x7f603406a5d0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564931841 0 0) 0x7f60340aeda0 con 0x7f603406a9b0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60340aeb50 con 0x7f603406a9b0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824461358 0 0) 0x7f601c0035d0 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 >> v1:172.21.15.73:6790/0 conn(0x7f603406a5d0 legacy=0x7f6034142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 >> v1:172.21.15.73:6789/0 conn(0x7f603406a9b0 legacy=0x7f6034142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603414de10 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f602c001990 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f602c001c70 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6031ffb700 1 -- 172.21.15.177:0/1145234396 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f602c002000 con 0x7f6034071af0 2024-09-16T14:37:05.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- 172.21.15.177:0/1145234396 >> v1:172.21.15.177:6789/0 conn(0x7f6034071af0 legacy=0x7f60341496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- 172.21.15.177:0/1145234396 shutdown_connections 2024-09-16T14:37:05.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- 172.21.15.177:0/1145234396 >> 172.21.15.177:0/1145234396 conn(0x7f60340b4570 msgr2=0x7f60340b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- 172.21.15.177:0/1145234396 shutdown_connections 2024-09-16T14:37:05.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- 172.21.15.177:0/1145234396 wait complete. 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 Processor -- start 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.204+0000 7f6033fff700 1 -- start start 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f6033fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6034137610 con 0x7f603406a5d0 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f6033fff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603406e950 con 0x7f6034071af0 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f6033fff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6034138d90 con 0x7f603406a9b0 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f60337fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6034071af0 0x7f6034136f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33744/0 (socket says 172.21.15.177:33744) 2024-09-16T14:37:05.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f60337fe700 1 -- 172.21.15.177:0/4199501095 learned_addr learned my addr 172.21.15.177:0/4199501095 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478738206 0 0) 0x7f603406e950 con 0x7f6034071af0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60200035d0 con 0x7f6034071af0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045192352 0 0) 0x7f6034137610 con 0x7f603406a5d0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603406e950 con 0x7f603406a5d0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105931561 0 0) 0x7f6034138d90 con 0x7f603406a9b0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6034137610 con 0x7f603406a9b0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3367544127 0 0) 0x7f60200035d0 con 0x7f6034071af0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6034138d90 con 0x7f6034071af0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f602c001950 con 0x7f6034071af0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 841937684 0 0) 0x7f6034138d90 con 0x7f6034071af0 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 >> v1:172.21.15.73:6790/0 conn(0x7f603406a9b0 legacy=0x7f60341367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 >> v1:172.21.15.73:6789/0 conn(0x7f603406a5d0 legacy=0x7f603406e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034139070 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6034139350 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f603406fe30 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f602c004ec0 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f602c0051d0 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f602c005630 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.208+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (unknown 3557140057 0 0) 0x7f602c005df0 con 0x7f6034071af0 2024-09-16T14:37:05.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.212+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6014005100 con 0x7f6034071af0 2024-09-16T14:37:05.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.212+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f602c006120 con 0x7f6034071af0 2024-09-16T14:37:05.273 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:05.270+0000 7f71064072c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T14:37:05.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.288+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f493a27b-6fca-494f-9031-d13e97c866e7", "id": 4} v 0) v1 -- 0x7f6014005930 con 0x7f6034071af0 2024-09-16T14:37:05.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.292+0000 7f601bfff700 1 -- 172.21.15.177:0/4199501095 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f493a27b-6fca-494f-9031-d13e97c866e7", "id": 4}]=0 v7) v1 ==== 112+0+2 (unknown 689745781 0 1697012583) 0x7f602c0059b0 con 0x7f6034071af0 2024-09-16T14:37:05.297 INFO:teuthology.orchestra.run.smithi177.stdout:4 2024-09-16T14:37:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.296+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 >> v1:172.21.15.177:6789/0 conn(0x7f6034071af0 legacy=0x7f6034136f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.296+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 shutdown_connections 2024-09-16T14:37:05.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.296+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 >> 172.21.15.177:0/4199501095 conn(0x7f60340b4570 msgr2=0x7f6034140400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.296+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 shutdown_connections 2024-09-16T14:37:05.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.296+0000 7f6033fff700 1 -- 172.21.15.177:0/4199501095 wait complete. 2024-09-16T14:37:05.312 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 076a5b78-a7c6-4897-8381-dd264f4f4be9 5 2024-09-16T14:37:05.324 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:05.322+0000 7f71064072c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T14:37:05.347 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:05.344+0000 7f9b9e4332c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T14:37:05.399 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:05.396+0000 7f9b9e4332c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T14:37:05.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 Processor -- start 2024-09-16T14:37:05.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- start start 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006ff30 con 0x7f0120145660 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006e030 con 0x7f012006da80 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006e550 con 0x7f0120073ba0 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011ffff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f012006da80 0x7f0120150830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33756/0 (socket says 172.21.15.177:33756) 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011ffff700 1 -- 172.21.15.177:0/1995675255 learned_addr learned my addr 172.21.15.177:0/1995675255 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237314905 0 0) 0x7f012006e030 con 0x7f012006da80 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01080035d0 con 0x7f012006da80 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343961717 0 0) 0x7f01080035d0 con 0x7f012006da80 2024-09-16T14:37:05.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 >> v1:172.21.15.73:6790/0 conn(0x7f0120073ba0 legacy=0x7f0120144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 >> v1:172.21.15.73:6789/0 conn(0x7f0120145660 legacy=0x7f0120142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01200af800 con 0x7f012006da80 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0118001990 con 0x7f012006da80 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0118001cb0 con 0x7f012006da80 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f011e7fc700 1 -- 172.21.15.177:0/1995675255 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0118002040 con 0x7f012006da80 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- 172.21.15.177:0/1995675255 >> v1:172.21.15.177:6789/0 conn(0x7f012006da80 legacy=0x7f0120150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- 172.21.15.177:0/1995675255 shutdown_connections 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- 172.21.15.177:0/1995675255 >> 172.21.15.177:0/1995675255 conn(0x7f01200b3090 msgr2=0x7f01200b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- 172.21.15.177:0/1995675255 shutdown_connections 2024-09-16T14:37:05.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.456+0000 7f012499d700 1 -- 172.21.15.177:0/1995675255 wait complete. 2024-09-16T14:37:05.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 Processor -- start 2024-09-16T14:37:05.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 -- start start 2024-09-16T14:37:05.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01201486f0 con 0x7f0120073ba0 2024-09-16T14:37:05.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01201489d0 con 0x7f012006da80 2024-09-16T14:37:05.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01201dded0 con 0x7f0120145660 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f011f7fe700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f012006da80 0x7f01201dd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33768/0 (socket says 172.21.15.177:33768) 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f011f7fe700 1 -- 172.21.15.177:0/1159038708 learned_addr learned my addr 172.21.15.177:0/1159038708 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270032796 0 0) 0x7f01201489d0 con 0x7f012006da80 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f010c0035d0 con 0x7f012006da80 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532088824 0 0) 0x7f01201486f0 con 0x7f0120073ba0 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01201489d0 con 0x7f0120073ba0 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159060201 0 0) 0x7f01201dded0 con 0x7f0120145660 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01201486f0 con 0x7f0120145660 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1407899952 0 0) 0x7f010c0035d0 con 0x7f012006da80 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f01201dded0 con 0x7f012006da80 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f01100018e0 con 0x7f012006da80 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1002426683 0 0) 0x7f01201489d0 con 0x7f0120073ba0 2024-09-16T14:37:05.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f010c0035d0 con 0x7f0120073ba0 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f01140017d0 con 0x7f0120073ba0 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 95587813 0 0) 0x7f01201dded0 con 0x7f012006da80 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 >> v1:172.21.15.73:6790/0 conn(0x7f0120145660 legacy=0x7f01201e5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 >> v1:172.21.15.73:6789/0 conn(0x7f0120073ba0 legacy=0x7f01200ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01201de060 con 0x7f012006da80 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0120149400 con 0x7f012006da80 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f01201490d0 con 0x7f012006da80 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f01100036c0 con 0x7f012006da80 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f01100039d0 con 0x7f012006da80 2024-09-16T14:37:05.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f0110003e30 con 0x7f012006da80 2024-09-16T14:37:05.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.460+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (unknown 3173161504 0 0) 0x7f01100064e0 con 0x7f012006da80 2024-09-16T14:37:05.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.464+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0100005100 con 0x7f012006da80 2024-09-16T14:37:05.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.468+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f0110005980 con 0x7f012006da80 2024-09-16T14:37:05.509 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:05.506+0000 7f71064072c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T14:37:05.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.544+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "076a5b78-a7c6-4897-8381-dd264f4f4be9", "id": 5} v 0) v1 -- 0x7f0100005930 con 0x7f012006da80 2024-09-16T14:37:05.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.548+0000 7f0107fff700 1 -- 172.21.15.177:0/1159038708 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "076a5b78-a7c6-4897-8381-dd264f4f4be9", "id": 5}]=0 v8) v1 ==== 112+0+2 (unknown 2340481021 0 1988412176) 0x7f01100042c0 con 0x7f012006da80 2024-09-16T14:37:05.553 INFO:teuthology.orchestra.run.smithi177.stdout:5 2024-09-16T14:37:05.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.552+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 >> v1:172.21.15.177:6789/0 conn(0x7f012006da80 legacy=0x7f01201dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.552+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 shutdown_connections 2024-09-16T14:37:05.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.552+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 >> 172.21.15.177:0/1159038708 conn(0x7f01200b3090 msgr2=0x7f01200ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.552+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 shutdown_connections 2024-09-16T14:37:05.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.552+0000 7f012499d700 1 -- 172.21.15.177:0/1159038708 wait complete. 2024-09-16T14:37:05.568 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 50df42c8-9444-4f81-acd2-68b6f84acd9b 6 2024-09-16T14:37:05.574 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:05.570+0000 7f71064072c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T14:37:05.579 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:05.576+0000 7f9b9e4332c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T14:37:05.638 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:05.634+0000 7f71064072c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T14:37:05.644 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:05.640+0000 7f9b9e4332c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0782976700 1 Processor -- start 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0782976700 1 -- start start 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0782976700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0af3e0 con 0x7f077c0acca0 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0782976700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0ad0d0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0782976700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c06b150 con 0x7f077c0b0d20 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0781173700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f077c0ad3d0 0x7f077c0ac590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33780/0 (socket says 172.21.15.177:33780) 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.676+0000 7f0781173700 1 -- 172.21.15.177:0/2384925208 learned_addr learned my addr 172.21.15.177:0/2384925208 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065854075 0 0) 0x7f077c0ad0d0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07680035d0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183812041 0 0) 0x7f077c0af3e0 con 0x7f077c0acca0 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f077c0ad0d0 con 0x7f077c0acca0 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238831923 0 0) 0x7f077c06b150 con 0x7f077c0b0d20 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f077c0af3e0 con 0x7f077c0b0d20 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286866169 0 0) 0x7f07680035d0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 >> v1:172.21.15.73:6790/0 conn(0x7f077c0b0d20 legacy=0x7f077c0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 >> v1:172.21.15.73:6789/0 conn(0x7f077c0acca0 legacy=0x7f077c14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c06b2e0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f076c001610 con 0x7f077c0ad3d0 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f076c001880 con 0x7f077c0ad3d0 2024-09-16T14:37:05.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0780972700 1 -- 172.21.15.177:0/2384925208 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f076c001c10 con 0x7f077c0ad3d0 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- 172.21.15.177:0/2384925208 >> v1:172.21.15.177:6789/0 conn(0x7f077c0ad3d0 legacy=0x7f077c0ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- 172.21.15.177:0/2384925208 shutdown_connections 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- 172.21.15.177:0/2384925208 >> 172.21.15.177:0/2384925208 conn(0x7f077c0b3ed0 msgr2=0x7f077c0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- 172.21.15.177:0/2384925208 shutdown_connections 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- 172.21.15.177:0/2384925208 wait complete. 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 Processor -- start 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- start start 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0ab310 con 0x7f077c0b0d20 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c070e10 con 0x7f077c0ad3d0 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0782976700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077c0a9aa0 con 0x7f077c0acca0 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0781173700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f077c0ad3d0 0x7f077c139110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33788/0 (socket says 172.21.15.177:33788) 2024-09-16T14:37:05.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.680+0000 7f0781173700 1 -- 172.21.15.177:0/1435087527 learned_addr learned my addr 172.21.15.177:0/1435087527 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074694826 0 0) 0x7f077c070e10 con 0x7f077c0ad3d0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07600035d0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055062211 0 0) 0x7f077c0ab310 con 0x7f077c0b0d20 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f077c070e10 con 0x7f077c0b0d20 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101089121 0 0) 0x7f077c0a9aa0 con 0x7f077c0acca0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f077c0ab310 con 0x7f077c0acca0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1554088029 0 0) 0x7f07600035d0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f077c0a9aa0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f076c001610 con 0x7f077c0ad3d0 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3821014887 0 0) 0x7f077c070e10 con 0x7f077c0b0d20 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07600035d0 con 0x7f077c0b0d20 2024-09-16T14:37:05.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0774001c30 con 0x7f077c0b0d20 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3172591061 0 0) 0x7f077c0ab310 con 0x7f077c0acca0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f077c070e10 con 0x7f077c0acca0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0778001810 con 0x7f077c0acca0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4022070886 0 0) 0x7f077c0a9aa0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 >> v1:172.21.15.73:6790/0 conn(0x7f077c0acca0 legacy=0x7f077c0a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 >> v1:172.21.15.73:6789/0 conn(0x7f077c0b0d20 legacy=0x7f077c0ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077c0a9c30 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077c0a87b0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f077c139a00 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f076c004be0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f076c004ef0 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f076c006480 con 0x7f077c0ad3d0 2024-09-16T14:37:05.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (unknown 2681505694 0 0) 0x7f076c005980 con 0x7f077c0ad3d0 2024-09-16T14:37:05.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.684+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0764005100 con 0x7f077c0ad3d0 2024-09-16T14:37:05.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.688+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f076c005110 con 0x7f077c0ad3d0 2024-09-16T14:37:05.708 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:05.704+0000 7f9b9e4332c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T14:37:05.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.760+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "50df42c8-9444-4f81-acd2-68b6f84acd9b", "id": 6} v 0) v1 -- 0x7f0764005930 con 0x7f077c0ad3d0 2024-09-16T14:37:05.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.768+0000 7f07727fc700 1 -- 172.21.15.177:0/1435087527 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50df42c8-9444-4f81-acd2-68b6f84acd9b", "id": 6}]=0 v9) v1 ==== 112+0+2 (unknown 1166645277 0 1113811849) 0x7f076c005400 con 0x7f077c0ad3d0 2024-09-16T14:37:05.771 INFO:teuthology.orchestra.run.smithi177.stdout:6 2024-09-16T14:37:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.768+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 >> v1:172.21.15.177:6789/0 conn(0x7f077c0ad3d0 legacy=0x7f077c139110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.768+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 shutdown_connections 2024-09-16T14:37:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.768+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 >> 172.21.15.177:0/1435087527 conn(0x7f077c0b3ed0 msgr2=0x7f077c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.768+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 shutdown_connections 2024-09-16T14:37:05.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.768+0000 7f0782976700 1 -- 172.21.15.177:0/1435087527 wait complete. 2024-09-16T14:37:05.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 2850af42-0ef9-4516-bdf0-2dc6119b1fb3 7 2024-09-16T14:37:05.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 Processor -- start 2024-09-16T14:37:05.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- start start 2024-09-16T14:37:05.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980aee60 con 0x7f309813e4b0 2024-09-16T14:37:05.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309806ef20 con 0x7f30980ae9f0 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309806f200 con 0x7f3098073c20 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309d761700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f30980ae9f0 0x7f309814c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33800/0 (socket says 172.21.15.177:33800) 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309d761700 1 -- 172.21.15.177:0/969500758 learned_addr learned my addr 172.21.15.177:0/969500758 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618385692 0 0) 0x7f309806ef20 con 0x7f30980ae9f0 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30880035d0 con 0x7f30980ae9f0 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2896039443 0 0) 0x7f30880035d0 con 0x7f30980ae9f0 2024-09-16T14:37:05.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 >> v1:172.21.15.73:6790/0 conn(0x7f3098073c20 legacy=0x7f309813dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 >> v1:172.21.15.73:6789/0 conn(0x7f309813e4b0 legacy=0x7f3098144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980af0c0 con 0x7f30980ae9f0 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3090001990 con 0x7f30980ae9f0 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3090001cb0 con 0x7f30980ae9f0 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f30977fe700 1 -- 172.21.15.177:0/969500758 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3090002040 con 0x7f30980ae9f0 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- 172.21.15.177:0/969500758 >> v1:172.21.15.177:6789/0 conn(0x7f30980ae9f0 legacy=0x7f309814c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- 172.21.15.177:0/969500758 shutdown_connections 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- 172.21.15.177:0/969500758 >> 172.21.15.177:0/969500758 conn(0x7f30980b3170 msgr2=0x7f30980b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- 172.21.15.177:0/969500758 shutdown_connections 2024-09-16T14:37:05.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 -- 172.21.15.177:0/969500758 wait complete. 2024-09-16T14:37:05.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.892+0000 7f309df62700 1 Processor -- start 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- start start 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309811d100 con 0x7f3098073c20 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309811d330 con 0x7f30980ae9f0 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309811d610 con 0x7f309813e4b0 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f3097fff700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f30980ae9f0 0x7f30981d60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:33810/0 (socket says 172.21.15.177:33810) 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f3097fff700 1 -- 172.21.15.177:0/655541704 learned_addr learned my addr 172.21.15.177:0/655541704 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142881671 0 0) 0x7f309811d330 con 0x7f30980ae9f0 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c0035d0 con 0x7f30980ae9f0 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073112070 0 0) 0x7f309811d100 con 0x7f3098073c20 2024-09-16T14:37:05.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f309811d330 con 0x7f3098073c20 2024-09-16T14:37:05.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4286462606 0 0) 0x7f307c0035d0 con 0x7f30980ae9f0 2024-09-16T14:37:05.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f309811d100 con 0x7f30980ae9f0 2024-09-16T14:37:05.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f30840018d0 con 0x7f30980ae9f0 2024-09-16T14:37:05.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579982529 0 0) 0x7f309811d610 con 0x7f309813e4b0 2024-09-16T14:37:05.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f307c0035d0 con 0x7f309813e4b0 2024-09-16T14:37:05.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3889136303 0 0) 0x7f309811d100 con 0x7f30980ae9f0 2024-09-16T14:37:05.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 >> v1:172.21.15.73:6790/0 conn(0x7f309813e4b0 legacy=0x7f30981d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 >> v1:172.21.15.73:6789/0 conn(0x7f3098073c20 legacy=0x7f309813a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098141600 con 0x7f30980ae9f0 2024-09-16T14:37:05.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309811bfb0 con 0x7f30980ae9f0 2024-09-16T14:37:05.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f309811b400 con 0x7f30980ae9f0 2024-09-16T14:37:05.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3084001c60 con 0x7f30980ae9f0 2024-09-16T14:37:05.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3084003b90 con 0x7f30980ae9f0 2024-09-16T14:37:05.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f3084004070 con 0x7f30980ae9f0 2024-09-16T14:37:05.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (unknown 2982564466 0 0) 0x7f3084006770 con 0x7f30980ae9f0 2024-09-16T14:37:05.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.896+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3078005100 con 0x7f30980ae9f0 2024-09-16T14:37:05.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.900+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f3084005870 con 0x7f30980ae9f0 2024-09-16T14:37:05.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.976+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2850af42-0ef9-4516-bdf0-2dc6119b1fb3", "id": 7} v 0) v1 -- 0x7f3078005930 con 0x7f30980ae9f0 2024-09-16T14:37:05.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.984+0000 7f30957fa700 1 -- 172.21.15.177:0/655541704 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2850af42-0ef9-4516-bdf0-2dc6119b1fb3", "id": 7}]=0 v10) v1 ==== 112+0+2 (unknown 2555829177 0 1371665406) 0x7f3084005a10 con 0x7f30980ae9f0 2024-09-16T14:37:05.987 INFO:teuthology.orchestra.run.smithi177.stdout:7 2024-09-16T14:37:05.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.984+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 >> v1:172.21.15.177:6789/0 conn(0x7f30980ae9f0 legacy=0x7f30981d60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:05.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.988+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 shutdown_connections 2024-09-16T14:37:05.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.988+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 >> 172.21.15.177:0/655541704 conn(0x7f30980b3170 msgr2=0x7f30980b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:05.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.988+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 shutdown_connections 2024-09-16T14:37:05.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-09-16T14:37:05.988+0000 7f309df62700 1 -- 172.21.15.177:0/655541704 wait complete. 2024-09-16T14:37:06.003 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T14:37:06.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T14:37:06.005 INFO:tasks.ceph.osd.0:Started 2024-09-16T14:37:06.006 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T14:37:06.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T14:37:06.008 INFO:tasks.ceph.osd.1:Started 2024-09-16T14:37:06.008 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T14:37:06.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T14:37:06.010 INFO:tasks.ceph.osd.2:Started 2024-09-16T14:37:06.010 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T14:37:06.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T14:37:06.012 INFO:tasks.ceph.osd.3:Started 2024-09-16T14:37:06.013 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T14:37:06.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T14:37:06.015 INFO:tasks.ceph.osd.4:Started 2024-09-16T14:37:06.015 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T14:37:06.015 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T14:37:06.017 INFO:tasks.ceph.osd.5:Started 2024-09-16T14:37:06.017 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-16T14:37:06.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-16T14:37:06.019 INFO:tasks.ceph.osd.6:Started 2024-09-16T14:37:06.019 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-16T14:37:06.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-16T14:37:06.022 INFO:tasks.ceph.osd.7:Started 2024-09-16T14:37:06.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:37:06.045 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:06.042+0000 7f71064072c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T14:37:06.116 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:06.112+0000 7f9b9e4332c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T14:37:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.138+0000 7f017f4e4700 1 Processor -- start 2024-09-16T14:37:06.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.138+0000 7f017f4e4700 1 -- start start 2024-09-16T14:37:06.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01780ab940 con 0x7f01780a9f90 2024-09-16T14:37:06.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01780abbb0 con 0x7f01780aee10 2024-09-16T14:37:06.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01780aa420 con 0x7f01780a9b60 2024-09-16T14:37:06.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017ca7f700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f01780a9b60 0x7f017813a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:55988/0 (socket says 172.21.15.73:55988) 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017ca7f700 1 -- 172.21.15.73:0/555135582 learned_addr learned my addr 172.21.15.73:0/555135582 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701337459 0 0) 0x7f01780aa420 con 0x7f01780a9b60 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01640035d0 con 0x7f01780a9b60 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153706440 0 0) 0x7f01780ab940 con 0x7f01780a9f90 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01780aa420 con 0x7f01780a9f90 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218428831 0 0) 0x7f01780abbb0 con 0x7f01780aee10 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01780ab940 con 0x7f01780aee10 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2066427851 0 0) 0x7f01780aa420 con 0x7f01780a9f90 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 >> v1:172.21.15.73:6790/0 conn(0x7f01780a9b60 legacy=0x7f017813a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 >> v1:172.21.15.177:6789/0 conn(0x7f01780aee10 legacy=0x7f01780ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01780aa940 con 0x7f01780a9f90 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0170001970 con 0x7f01780a9f90 2024-09-16T14:37:06.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0170001c00 con 0x7f01780a9f90 2024-09-16T14:37:06.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f016ffff700 1 -- 172.21.15.73:0/555135582 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0170001f90 con 0x7f01780a9f90 2024-09-16T14:37:06.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- 172.21.15.73:0/555135582 >> v1:172.21.15.73:6789/0 conn(0x7f01780a9f90 legacy=0x7f0178148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:06.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- 172.21.15.73:0/555135582 shutdown_connections 2024-09-16T14:37:06.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- 172.21.15.73:0/555135582 >> 172.21.15.73:0/555135582 conn(0x7f017806a360 msgr2=0x7f017806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:06.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- 172.21.15.73:0/555135582 shutdown_connections 2024-09-16T14:37:06.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.142+0000 7f017f4e4700 1 -- 172.21.15.73:0/555135582 wait complete. 2024-09-16T14:37:06.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017f4e4700 1 Processor -- start 2024-09-16T14:37:06.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017f4e4700 1 -- start start 2024-09-16T14:37:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017f4e4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017813be50 con 0x7f01781da490 2024-09-16T14:37:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017f4e4700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017813def0 con 0x7f01780a9b60 2024-09-16T14:37:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017f4e4700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017813b280 con 0x7f01780aee10 2024-09-16T14:37:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017ca7f700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f01780aee10 0x7f01781c7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:55992/0 (socket says 172.21.15.73:55992) 2024-09-16T14:37:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017da81700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f01781da490 0x7f01781dc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48894/0 (socket says 172.21.15.73:48894) 2024-09-16T14:37:06.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f017ca7f700 1 -- 172.21.15.73:0/3791179142 learned_addr learned my addr 172.21.15.73:0/3791179142 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:06.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640215619 0 0) 0x7f017813b280 con 0x7f01780aee10 2024-09-16T14:37:06.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f015c0035d0 con 0x7f01780aee10 2024-09-16T14:37:06.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291417811 0 0) 0x7f017813be50 con 0x7f01781da490 2024-09-16T14:37:06.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f017813b280 con 0x7f01781da490 2024-09-16T14:37:06.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129144421 0 0) 0x7f017813def0 con 0x7f01780a9b60 2024-09-16T14:37:06.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f017813be50 con 0x7f01780a9b60 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 54250642 0 0) 0x7f017813b280 con 0x7f01781da490 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f017813def0 con 0x7f01781da490 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.146+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0170001870 con 0x7f01781da490 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 671915028 0 0) 0x7f015c0035d0 con 0x7f01780aee10 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f017813b280 con 0x7f01780aee10 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0168001850 con 0x7f01780aee10 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2335209149 0 0) 0x7f017813be50 con 0x7f01780a9b60 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f015c0035d0 con 0x7f01780a9b60 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0174001810 con 0x7f01780a9b60 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 569198360 0 0) 0x7f017813b280 con 0x7f01780aee10 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 >> v1:172.21.15.177:6789/0 conn(0x7f01780a9b60 legacy=0x7f017813cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 >> v1:172.21.15.73:6789/0 conn(0x7f01781da490 legacy=0x7f01781dc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017813c0a0 con 0x7f01780aee10 2024-09-16T14:37:06.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0178141750 con 0x7f01780aee10 2024-09-16T14:37:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f017813c7a0 con 0x7f01780aee10 2024-09-16T14:37:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0168001d60 con 0x7f01780aee10 2024-09-16T14:37:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0168004ab0 con 0x7f01780aee10 2024-09-16T14:37:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f0168004f90 con 0x7f01780aee10 2024-09-16T14:37:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (unknown 3113040993 0 0) 0x7f01680065c0 con 0x7f01780aee10 2024-09-16T14:37:06.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.150+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0158005100 con 0x7f01780aee10 2024-09-16T14:37:06.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.154+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f0168006000 con 0x7f01780aee10 2024-09-16T14:37:06.182 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:06.178+0000 7f71064072c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T14:37:06.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.218+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01580053b0 con 0x7f01780aee10 2024-09-16T14:37:06.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.218+0000 7f016dffb700 1 -- 172.21.15.73:0/3791179142 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (unknown 4040575075 0 4141389368) 0x7f0168006250 con 0x7f01780aee10 2024-09-16T14:37:06.223 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:06.223 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"00a48c31-0009-4414-a6e8-5009f0ad4af8","created":"2024-09-16T14:37:03.904421+0000","modified":"2024-09-16T14:37:05.980210+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T14:37:05.980210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d48450e-baaa-42ad-93b9-30c34ec79d62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58e40796-3999-48ed-a83f-ad57036a99c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53fdea0d-c928-4266-bfc7-9fbd991a9fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fbf3a6da-fa7d-4901-86bd-fe8c90665a54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f493a27b-6fca-494f-9031-d13e97c866e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"076a5b78-a7c6-4897-8381-dd264f4f4be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"50df42c8-9444-4f81-acd2-68b6f84acd9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2850af42-0ef9-4516-bdf0-2dc6119b1fb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:37:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.218+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 >> v1:172.21.15.73:6790/0 conn(0x7f01780aee10 legacy=0x7f01781c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.218+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 shutdown_connections 2024-09-16T14:37:06.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.218+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 >> 172.21.15.73:0/3791179142 conn(0x7f017806a360 msgr2=0x7f01780a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:06.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.222+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 shutdown_connections 2024-09-16T14:37:06.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:06.222+0000 7f017f4e4700 1 -- 172.21.15.73:0/3791179142 wait complete. 2024-09-16T14:37:06.233 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:06.228+0000 7f9b9e4332c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T14:37:06.235 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T14:37:06.235 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T14:37:06.386 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T14:37:06.382+0000 7f5931749880 -1 Falling back to public interface 2024-09-16T14:37:06.401 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T14:37:06.398+0000 7f022748c880 -1 Falling back to public interface 2024-09-16T14:37:06.402 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-16T14:37:06.400+0000 7fc450b4b880 -1 Falling back to public interface 2024-09-16T14:37:06.403 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-16T14:37:06.400+0000 7f86ef30e880 -1 Falling back to public interface 2024-09-16T14:37:06.403 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-16T14:37:06.400+0000 7fc44fb16700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2024-09-16T14:37:06.514 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:06.510+0000 7f71064072c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T14:37:06.565 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:06.564+0000 7f9b9e4332c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T14:37:06.646 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T14:37:06.642+0000 7f1cb4bd6880 -1 Falling back to public interface 2024-09-16T14:37:06.658 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-16T14:37:06.656+0000 7f4147675880 -1 Falling back to public interface 2024-09-16T14:37:06.659 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-16T14:37:06.656+0000 7f52b3fc4880 -1 Falling back to public interface 2024-09-16T14:37:06.669 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-16T14:37:06.666+0000 7f015ee30880 -1 Falling back to public interface 2024-09-16T14:37:06.702 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:06.698+0000 7f71064072c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T14:37:06.756 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:06.752+0000 7f9b9e4332c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T14:37:06.769 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:06.766+0000 7f71064072c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T14:37:06.824 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:06.820+0000 7f9b9e4332c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T14:37:06.929 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:06.926+0000 7f71064072c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T14:37:06.986 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:06.984+0000 7f9b9e4332c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T14:37:07.041 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T14:37:07.142 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f61749fe700 1 Processor -- start 2024-09-16T14:37:07.143 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f61749fe700 1 -- start start 2024-09-16T14:37:07.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f61749fe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700ae090 con 0x7f61700aff50 2024-09-16T14:37:07.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f61749fe700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700b11a0 con 0x7f617013e760 2024-09-16T14:37:07.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f61749fe700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700b2990 con 0x7f617006b0f0 2024-09-16T14:37:07.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f616effd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f61700aff50 0x7f617013e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48900/0 (socket says 172.21.15.73:48900) 2024-09-16T14:37:07.144 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f616effd700 1 -- 172.21.15.73:0/52627527 learned_addr learned my addr 172.21.15.73:0/52627527 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566043471 0 0) 0x7f61700ae090 con 0x7f61700aff50 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c0035d0 con 0x7f61700aff50 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887467225 0 0) 0x7f61700b2990 con 0x7f617006b0f0 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.138+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61700ae090 con 0x7f617006b0f0 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708126890 0 0) 0x7f615c0035d0 con 0x7f61700aff50 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 >> v1:172.21.15.73:6790/0 conn(0x7f617006b0f0 legacy=0x7f61700723e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 >> v1:172.21.15.177:6789/0 conn(0x7f617013e760 legacy=0x7f617014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700b3190 con 0x7f61700aff50 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6158001990 con 0x7f61700aff50 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6158001bb0 con 0x7f61700aff50 2024-09-16T14:37:07.145 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f616e7fc700 1 -- 172.21.15.73:0/52627527 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6158001f40 con 0x7f61700aff50 2024-09-16T14:37:07.146 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 -- 172.21.15.73:0/52627527 >> v1:172.21.15.73:6789/0 conn(0x7f61700aff50 legacy=0x7f617013e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:07.146 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 -- 172.21.15.73:0/52627527 shutdown_connections 2024-09-16T14:37:07.146 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 -- 172.21.15.73:0/52627527 >> 172.21.15.73:0/52627527 conn(0x7f617006a360 msgr2=0x7f617006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:07.146 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 -- 172.21.15.73:0/52627527 shutdown_connections 2024-09-16T14:37:07.146 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 -- 172.21.15.73:0/52627527 wait complete. 2024-09-16T14:37:07.148 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 Processor -- start 2024-09-16T14:37:07.148 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.142+0000 7f61749fe700 1 -- start start 2024-09-16T14:37:07.148 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f61749fe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617013b6c0 con 0x7f617013e760 2024-09-16T14:37:07.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f61749fe700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617006dc00 con 0x7f61700aff50 2024-09-16T14:37:07.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f61749fe700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617013f410 con 0x7f617006b0f0 2024-09-16T14:37:07.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f616ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f617013e760 0x7f617013afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48914/0 (socket says 172.21.15.73:48914) 2024-09-16T14:37:07.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f616ffff700 1 -- 172.21.15.73:0/2064871846 learned_addr learned my addr 172.21.15.73:0/2064871846 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262032918 0 0) 0x7f617013f410 con 0x7f617006b0f0 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61500035d0 con 0x7f617006b0f0 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680438404 0 0) 0x7f617013b6c0 con 0x7f617013e760 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f617013f410 con 0x7f617013e760 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3725758407 0 0) 0x7f61500035d0 con 0x7f617006b0f0 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f617013b6c0 con 0x7f617006b0f0 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6168001790 con 0x7f617006b0f0 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587589647 0 0) 0x7f617006dc00 con 0x7f61700aff50 2024-09-16T14:37:07.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61500035d0 con 0x7f61700aff50 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3377193595 0 0) 0x7f617013f410 con 0x7f617013e760 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f617006dc00 con 0x7f617013e760 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f61600018c0 con 0x7f617013e760 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2717223684 0 0) 0x7f617013b6c0 con 0x7f617006b0f0 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 >> v1:172.21.15.177:6789/0 conn(0x7f61700aff50 legacy=0x7f617013a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 >> v1:172.21.15.73:6789/0 conn(0x7f617013e760 legacy=0x7f617013afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170144fd0 con 0x7f617006b0f0 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61701444c0 con 0x7f617006b0f0 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f617013f930 con 0x7f617006b0f0 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f61680036a0 con 0x7f617006b0f0 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f61680039b0 con 0x7f617006b0f0 2024-09-16T14:37:07.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 1) v1 ==== 668+0+0 (unknown 3836259515 0 0) 0x7f6168003e10 con 0x7f617006b0f0 2024-09-16T14:37:07.153 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (unknown 3113040993 0 0) 0x7f6168005490 con 0x7f617006b0f0 2024-09-16T14:37:07.153 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.146+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6154005100 con 0x7f617006b0f0 2024-09-16T14:37:07.153 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.150+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (unknown 1092875540 0 2019800707) 0x7f6168004ed0 con 0x7f617006b0f0 2024-09-16T14:37:07.218 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.214+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61540053b0 con 0x7f617006b0f0 2024-09-16T14:37:07.219 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.214+0000 7f6167fff700 1 -- 172.21.15.73:0/2064871846 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (unknown 4040575075 0 4141389368) 0x7f6168005120 con 0x7f617006b0f0 2024-09-16T14:37:07.219 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-16T14:37:07.219 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"00a48c31-0009-4414-a6e8-5009f0ad4af8","created":"2024-09-16T14:37:03.904421+0000","modified":"2024-09-16T14:37:05.980210+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T14:37:05.980210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1d48450e-baaa-42ad-93b9-30c34ec79d62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58e40796-3999-48ed-a83f-ad57036a99c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53fdea0d-c928-4266-bfc7-9fbd991a9fb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fbf3a6da-fa7d-4901-86bd-fe8c90665a54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f493a27b-6fca-494f-9031-d13e97c866e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"076a5b78-a7c6-4897-8381-dd264f4f4be9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"50df42c8-9444-4f81-acd2-68b6f84acd9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2850af42-0ef9-4516-bdf0-2dc6119b1fb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:37:07.221 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.218+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 >> v1:172.21.15.73:6790/0 conn(0x7f617006b0f0 legacy=0x7f6170140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:07.221 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.218+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 shutdown_connections 2024-09-16T14:37:07.221 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.218+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 >> 172.21.15.73:0/2064871846 conn(0x7f617006a360 msgr2=0x7f61701cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:07.221 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.218+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 shutdown_connections 2024-09-16T14:37:07.221 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:07.218+0000 7f61749fe700 1 -- 172.21.15.73:0/2064871846 wait complete. 2024-09-16T14:37:07.235 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T14:37:07.712 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:07.708+0000 7f9b9e4332c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T14:37:07.745 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:07.742+0000 7f71064072c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T14:37:07.779 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:07.776+0000 7f9b9e4332c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T14:37:07.815 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:07.810+0000 7f71064072c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T14:37:07.937 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:07.936+0000 7f9b9e4332c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T14:37:07.975 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:07.970+0000 7f71064072c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T14:37:07.998 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:07.996+0000 7f9b9e4332c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T14:37:08.042 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:08.038+0000 7f71064072c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T14:37:08.067 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:08.064+0000 7f9b9e4332c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T14:37:08.117 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:08.110+0000 7f71064072c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T14:37:08.371 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:08.368+0000 7f9b9e4332c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T14:37:08.436 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:08.430+0000 7f71064072c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T14:37:08.441 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:08.436+0000 7f9b9e4332c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T14:37:08.512 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:08.510+0000 7f71064072c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T14:37:09.115 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:09.112+0000 7f9b9e4332c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T14:37:09.218 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-09-16T14:37:09.214+0000 7f71064072c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T14:37:09.731 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-16T14:37:09.728+0000 7f4147675880 -1 osd.7 0 log_to_monitors true 2024-09-16T14:37:09.774 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-16T14:37:09.770+0000 7f015ee30880 -1 osd.3 0 log_to_monitors true 2024-09-16T14:37:09.953 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-16T14:37:09.952+0000 7fc450b4b880 -1 osd.4 0 log_to_monitors true 2024-09-16T14:37:10.028 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-16T14:37:10.024+0000 7f52b3fc4880 -1 osd.5 0 log_to_monitors true 2024-09-16T14:37:10.204 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T14:37:10.198+0000 7f022748c880 -1 osd.0 0 log_to_monitors true 2024-09-16T14:37:10.234 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T14:37:10.230+0000 7f5931749880 -1 osd.2 0 log_to_monitors true 2024-09-16T14:37:10.237 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-16T14:37:10.236+0000 7f86ef30e880 -1 osd.6 0 log_to_monitors true 2024-09-16T14:37:10.320 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T14:37:10.318+0000 7f1cb4bd6880 -1 osd.1 0 log_to_monitors true 2024-09-16T14:37:11.242 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-16T14:37:11.240+0000 7f41434b4700 -1 osd.7 0 waiting for initial osdmap 2024-09-16T14:37:11.244 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-16T14:37:11.240+0000 7fc44c98a700 -1 osd.4 0 waiting for initial osdmap 2024-09-16T14:37:11.246 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:11.244+0000 7f9b84faa700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T14:37:11.247 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-09-16T14:37:11.244+0000 7f9b84faa700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T14:37:11.249 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-09-16T14:37:11.248+0000 7f413ef6b700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:11.250 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-09-16T14:37:11.248+0000 7fc448441700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:12.044 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-16T14:37:12.040+0000 7f52afe03700 -1 osd.5 0 waiting for initial osdmap 2024-09-16T14:37:12.049 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-09-16T14:37:12.048+0000 7f52a78b2700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:12.075 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-16T14:37:12.070+0000 7f015ac6f700 -1 osd.3 0 waiting for initial osdmap 2024-09-16T14:37:12.083 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-09-16T14:37:12.078+0000 7f015271e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:12.237 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T14:37:12.234+0000 7f02232cb700 -1 osd.0 0 waiting for initial osdmap 2024-09-16T14:37:12.238 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T14:37:12.234+0000 7f1cb0a15700 -1 osd.1 0 waiting for initial osdmap 2024-09-16T14:37:12.247 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-09-16T14:37:12.242+0000 7f1cac4cc700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:12.247 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-09-16T14:37:12.242+0000 7f021ed82700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:13.077 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-16T14:37:13.076+0000 7f86eb14d700 -1 osd.6 0 waiting for initial osdmap 2024-09-16T14:37:13.082 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-09-16T14:37:13.080+0000 7f86e2bfc700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:13.133 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T14:37:13.130+0000 7f592d588700 -1 osd.2 0 waiting for initial osdmap 2024-09-16T14:37:13.140 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-09-16T14:37:13.138+0000 7f5925037700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T14:37:14.043 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T14:37:14.148 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 Processor -- start 2024-09-16T14:37:14.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- start start 2024-09-16T14:37:14.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980aee30 con 0x7f5a980ace30 2024-09-16T14:37:14.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9813ec00 con 0x7f5a980adf80 2024-09-16T14:37:14.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980af080 con 0x7f5a980afe90 2024-09-16T14:37:14.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9cab1700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f5a980afe90 0x7f5a9813dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:56068/0 (socket says 172.21.15.73:56068) 2024-09-16T14:37:14.149 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9cab1700 1 -- 172.21.15.73:0/1941587089 learned_addr learned my addr 172.21.15.73:0/1941587089 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:14.150 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9d2b2700 1 --1- 172.21.15.73:0/1941587089 >> v1:172.21.15.73:6789/0 conn(0x7f5a980ace30 0x7f5a980af780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48982/0 (socket says 172.21.15.73:48982) 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680446129 0 0) 0x7f5a980aee30 con 0x7f5a980ace30 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a840035d0 con 0x7f5a980ace30 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066296267 0 0) 0x7f5a980af080 con 0x7f5a980afe90 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a980aee30 con 0x7f5a980afe90 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924059364 0 0) 0x7f5a9813ec00 con 0x7f5a980adf80 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a980af080 con 0x7f5a980adf80 2024-09-16T14:37:14.151 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1136049564 0 0) 0x7f5a840035d0 con 0x7f5a980ace30 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 >> v1:172.21.15.73:6790/0 conn(0x7f5a980afe90 legacy=0x7f5a9813dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 >> v1:172.21.15.177:6789/0 conn(0x7f5a980adf80 legacy=0x7f5a9813e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980b08f0 con 0x7f5a980ace30 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5a94001610 con 0x7f5a980ace30 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5a94001870 con 0x7f5a980ace30 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a8ffff700 1 -- 172.21.15.73:0/1941587089 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5a94001c40 con 0x7f5a980ace30 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- 172.21.15.73:0/1941587089 >> v1:172.21.15.73:6789/0 conn(0x7f5a980ace30 legacy=0x7f5a980af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- 172.21.15.73:0/1941587089 shutdown_connections 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- 172.21.15.73:0/1941587089 >> 172.21.15.73:0/1941587089 conn(0x7f5a980b6d80 msgr2=0x7f5a980b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- 172.21.15.73:0/1941587089 shutdown_connections 2024-09-16T14:37:14.152 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.146+0000 7f5a9f516700 1 -- 172.21.15.73:0/1941587089 wait complete. 2024-09-16T14:37:14.153 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 Processor -- start 2024-09-16T14:37:14.153 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 -- start start 2024-09-16T14:37:14.154 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a98138c10 con 0x7f5a980ace30 2024-09-16T14:37:14.154 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9813a090 con 0x7f5a980afe90 2024-09-16T14:37:14.154 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9813a370 con 0x7f5a980adf80 2024-09-16T14:37:14.154 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9d2b2700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5a980ace30 0x7f5a98134b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48986/0 (socket says 172.21.15.73:48986) 2024-09-16T14:37:14.154 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9d2b2700 1 -- 172.21.15.73:0/3298816333 learned_addr learned my addr 172.21.15.73:0/3298816333 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231488285 0 0) 0x7f5a98138c10 con 0x7f5a980ace30 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a7c0035d0 con 0x7f5a980ace30 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847005916 0 0) 0x7f5a9813a370 con 0x7f5a980adf80 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a98138c10 con 0x7f5a980adf80 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501233206 0 0) 0x7f5a9813a090 con 0x7f5a980afe90 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a9813a370 con 0x7f5a980afe90 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2496204717 0 0) 0x7f5a7c0035d0 con 0x7f5a980ace30 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a9813a090 con 0x7f5a980ace30 2024-09-16T14:37:14.156 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5a94001b80 con 0x7f5a980ace30 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 956554646 0 0) 0x7f5a98138c10 con 0x7f5a980adf80 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5a7c0035d0 con 0x7f5a980adf80 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5a88001770 con 0x7f5a980adf80 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 653353583 0 0) 0x7f5a9813a090 con 0x7f5a980ace30 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 >> v1:172.21.15.73:6790/0 conn(0x7f5a980adf80 legacy=0x7f5a9813a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 >> v1:172.21.15.177:6789/0 conn(0x7f5a980afe90 legacy=0x7f5a9813aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a981370d0 con 0x7f5a980ace30 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a981390a0 con 0x7f5a980ace30 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a98135420 con 0x7f5a980ace30 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5a94004be0 con 0x7f5a980ace30 2024-09-16T14:37:14.157 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.150+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5a94004ef0 con 0x7f5a980ace30 2024-09-16T14:37:14.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.154+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78005100 con 0x7f5a980ace30 2024-09-16T14:37:14.158 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.154+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 4) v1 ==== 86001+0+0 (unknown 1350192129 0 0) 0x7f5a9401a050 con 0x7f5a980ace30 2024-09-16T14:37:14.159 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.154+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3726+0+0 (unknown 977946848 0 0) 0x7f5a9407f430 con 0x7f5a980ace30 2024-09-16T14:37:14.167 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.162+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f5a9404ce40 con 0x7f5a980ace30 2024-09-16T14:37:14.345 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.342+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a780053b0 con 0x7f5a980ace30 2024-09-16T14:37:14.346 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.342+0000 7f5a8dffb700 1 -- 172.21.15.73:0/3298816333 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10899 (unknown 4221056075 0 518226117) 0x7f5a9404ed70 con 0x7f5a980ace30 2024-09-16T14:37:14.347 INFO:teuthology.misc.health.smithi073.stdout: 2024-09-16T14:37:14.347 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":15,"fsid":"00a48c31-0009-4414-a6e8-5009f0ad4af8","created":"2024-09-16T14:37:03.904421+0000","modified":"2024-09-16T14:37:14.247134+0000","last_up_change":"2024-09-16T14:37:13.233269+0000","last_in_change":"2024-09-16T14:37:05.980210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T14:37:13.207309+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d48450e-baaa-42ad-93b9-30c34ec79d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3200602632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3200602632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3200602632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3200602632}]},"public_addr":"172.21.15.73:6804/3200602632","cluster_addr":"172.21.15.73:6805/3200602632","heartbeat_back_addr":"172.21.15.73:6807/3200602632","heartbeat_front_addr":"172.21.15.73:6806/3200602632","state":["exists","up"]},{"osd":1,"uuid":"58e40796-3999-48ed-a83f-ad57036a99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":342316973}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":342316973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":342316973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":342316973}]},"public_addr":"172.21.15.73:6808/342316973","cluster_addr":"172.21.15.73:6809/342316973","heartbeat_back_addr":"172.21.15.73:6811/342316973","heartbeat_front_addr":"172.21.15.73:6810/342316973","state":["exists","up"]},{"osd":2,"uuid":"53fdea0d-c928-4266-bfc7-9fbd991a9fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":303375583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":303375583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":303375583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":303375583}]},"public_addr":"172.21.15.73:6800/303375583","cluster_addr":"172.21.15.73:6801/303375583","heartbeat_back_addr":"172.21.15.73:6803/303375583","heartbeat_front_addr":"172.21.15.73:6802/303375583","state":["exists","up"]},{"osd":3,"uuid":"fbf3a6da-fa7d-4901-86bd-fe8c90665a54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":1569396656}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":1569396656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":1569396656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":1569396656}]},"public_addr":"172.21.15.73:6812/1569396656","cluster_addr":"172.21.15.73:6813/1569396656","heartbeat_back_addr":"172.21.15.73:6815/1569396656","heartbeat_front_addr":"172.21.15.73:6814/1569396656","state":["exists","up"]},{"osd":4,"uuid":"f493a27b-6fca-494f-9031-d13e97c866e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6801","nonce":573978299}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6803","nonce":573978299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6807","nonce":573978299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6805","nonce":573978299}]},"public_addr":"172.21.15.177:6801/573978299","cluster_addr":"172.21.15.177:6803/573978299","heartbeat_back_addr":"172.21.15.177:6807/573978299","heartbeat_front_addr":"172.21.15.177:6805/573978299","state":["exists","up"]},{"osd":5,"uuid":"076a5b78-a7c6-4897-8381-dd264f4f4be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6809","nonce":702447135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6811","nonce":702447135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6815","nonce":702447135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6813","nonce":702447135}]},"public_addr":"172.21.15.177:6809/702447135","cluster_addr":"172.21.15.177:6811/702447135","heartbeat_back_addr":"172.21.15.177:6815/702447135","heartbeat_front_addr":"172.21.15.177:6813/702447135","state":["exists","up"]},{"osd":6,"uuid":"50df42c8-9444-4f81-acd2-68b6f84acd9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6800","nonce":877193733}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6802","nonce":877193733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6806","nonce":877193733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6804","nonce":877193733}]},"public_addr":"172.21.15.177:6800/877193733","cluster_addr":"172.21.15.177:6802/877193733","heartbeat_back_addr":"172.21.15.177:6806/877193733","heartbeat_front_addr":"172.21.15.177:6804/877193733","state":["exists","up"]},{"osd":7,"uuid":"2850af42-0ef9-4516-bdf0-2dc6119b1fb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6808","nonce":3844040909}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6810","nonce":3844040909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6814","nonce":3844040909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6812","nonce":3844040909}]},"public_addr":"172.21.15.177:6808/3844040909","cluster_addr":"172.21.15.177:6810/3844040909","heartbeat_back_addr":"172.21.15.177:6814/3844040909","heartbeat_front_addr":"172.21.15.177:6812/3844040909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.217458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.306016+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.250219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.823535+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.942853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.045593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.231206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.777308+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:37:14.350 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.346+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 >> v1:172.21.15.177:6816/2823028339 conn(0x7f5a7c0671a0 legacy=0x7f5a7c069660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.350 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.346+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 >> v1:172.21.15.73:6789/0 conn(0x7f5a980ace30 legacy=0x7f5a98134b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.350 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.346+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 shutdown_connections 2024-09-16T14:37:14.350 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.346+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 >> 172.21.15.73:0/3298816333 conn(0x7f5a980b6d80 msgr2=0x7f5a9813d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:14.350 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.346+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 shutdown_connections 2024-09-16T14:37:14.350 INFO:teuthology.misc.health.smithi073.stderr:2024-09-16T14:37:14.346+0000 7f5a9f516700 1 -- 172.21.15.73:0/3298816333 wait complete. 2024-09-16T14:37:14.362 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-16T14:37:14.363 INFO:tasks.ceph:Creating RBD pool 2024-09-16T14:37:14.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-16T14:37:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c6a1c700 1 Processor -- start 2024-09-16T14:37:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c6a1c700 1 -- start start 2024-09-16T14:37:14.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c6a1c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00b33e0 con 0x7f46c00b2e50 2024-09-16T14:37:14.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c6a1c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00a9c40 con 0x7f46c006c190 2024-09-16T14:37:14.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c6a1c700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00a8a20 con 0x7f46c013e580 2024-09-16T14:37:14.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c621b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f46c00b2e50 0x7f46c014c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46896/0 (socket says 172.21.15.73:46896) 2024-09-16T14:37:14.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.474+0000 7f46c621b700 1 -- 172.21.15.73:0/3892382862 learned_addr learned my addr 172.21.15.73:0/3892382862 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774029696 0 0) 0x7f46c00a8a20 con 0x7f46c013e580 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46ac0035d0 con 0x7f46c013e580 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683341407 0 0) 0x7f46c00b33e0 con 0x7f46c00b2e50 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c00a8a20 con 0x7f46c00b2e50 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917083373 0 0) 0x7f46c00a9c40 con 0x7f46c006c190 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c00b33e0 con 0x7f46c006c190 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795138653 0 0) 0x7f46ac0035d0 con 0x7f46c013e580 2024-09-16T14:37:14.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 >> v1:172.21.15.177:6789/0 conn(0x7f46c006c190 legacy=0x7f46c013de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 >> v1:172.21.15.73:6789/0 conn(0x7f46c00b2e50 legacy=0x7f46c014c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00a8ce0 con 0x7f46c013e580 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f46b0001610 con 0x7f46c013e580 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f46b00018f0 con 0x7f46c013e580 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c4a18700 1 -- 172.21.15.73:0/3892382862 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f46b0001c80 con 0x7f46c013e580 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 -- 172.21.15.73:0/3892382862 >> v1:172.21.15.73:6790/0 conn(0x7f46c013e580 legacy=0x7f46c0144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 -- 172.21.15.73:0/3892382862 shutdown_connections 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 -- 172.21.15.73:0/3892382862 >> 172.21.15.73:0/3892382862 conn(0x7f46c00b6a90 msgr2=0x7f46c00b6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 -- 172.21.15.73:0/3892382862 shutdown_connections 2024-09-16T14:37:14.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 -- 172.21.15.73:0/3892382862 wait complete. 2024-09-16T14:37:14.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 Processor -- start 2024-09-16T14:37:14.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.478+0000 7f46c6a1c700 1 -- start start 2024-09-16T14:37:14.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c6a1c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00ab4d0 con 0x7f46c00b2e50 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c6a1c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00aa870 con 0x7f46c006c190 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c6a1c700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c01d8e40 con 0x7f46c013e580 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c5219700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f46c00b2e50 0x7f46c01d9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46900/0 (socket says 172.21.15.73:46900) 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c5219700 1 -- 172.21.15.73:0/1307478336 learned_addr learned my addr 172.21.15.73:0/1307478336 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447114647 0 0) 0x7f46c00ab4d0 con 0x7f46c00b2e50 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a40035d0 con 0x7f46c00b2e50 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107469039 0 0) 0x7f46c01d8e40 con 0x7f46c013e580 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c00ab4d0 con 0x7f46c013e580 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797563654 0 0) 0x7f46c00aa870 con 0x7f46c006c190 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46c01d8e40 con 0x7f46c006c190 2024-09-16T14:37:14.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2568593709 0 0) 0x7f46c00ab4d0 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f46c00aa870 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f46b8001c30 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2736854517 0 0) 0x7f46a40035d0 con 0x7f46c00b2e50 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f46c00ab4d0 con 0x7f46c00b2e50 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f46b0001c40 con 0x7f46c00b2e50 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1477005868 0 0) 0x7f46c00aa870 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 >> v1:172.21.15.177:6789/0 conn(0x7f46c006c190 legacy=0x7f46c00ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 >> v1:172.21.15.73:6789/0 conn(0x7f46c00b2e50 legacy=0x7f46c01d9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00abc00 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c00ac8f0 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0140610 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f46b8004c10 con 0x7f46c013e580 2024-09-16T14:37:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f46b8004f20 con 0x7f46c013e580 2024-09-16T14:37:14.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.482+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a8005100 con 0x7f46c013e580 2024-09-16T14:37:14.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.486+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 4) v1 ==== 86001+0+0 (unknown 1350192129 0 0) 0x7f46b801a080 con 0x7f46c013e580 2024-09-16T14:37:14.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.486+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3737+0+0 (unknown 2042182209 0 0) 0x7f46b807f370 con 0x7f46c013e580 2024-09-16T14:37:14.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.494+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f46b804ceb0 con 0x7f46c013e580 2024-09-16T14:37:14.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:14.666+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f46a8005930 con 0x7f46c013e580 2024-09-16T14:37:15.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.266+0000 7f46b67fc700 1 -- 172.21.15.73:0/1307478336 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (unknown 231814880 0 0) 0x7f46b804ede0 con 0x7f46c013e580 2024-09-16T14:37:15.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.270+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 >> v1:172.21.15.177:6816/2823028339 conn(0x7f46a4067230 legacy=0x7f46a40696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.270+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 >> v1:172.21.15.73:6790/0 conn(0x7f46c013e580 legacy=0x7f46c0138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.270+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 shutdown_connections 2024-09-16T14:37:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.270+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 >> 172.21.15.73:0/1307478336 conn(0x7f46c00b6a90 msgr2=0x7f46c01439f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.270+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 shutdown_connections 2024-09-16T14:37:15.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.270+0000 7f46c6a1c700 1 -- 172.21.15.73:0/1307478336 wait complete. 2024-09-16T14:37:15.276 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-09-16T14:37:15.289 DEBUG:teuthology.orchestra.run.smithi073:> rbd --cluster ceph pool init rbd 2024-09-16T14:37:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.338+0000 7f54ae881780 1 Processor -- start 2024-09-16T14:37:15.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.338+0000 7f54ae881780 1 -- start start 2024-09-16T14:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.338+0000 7f54ae881780 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5628d5919ca0 con 0x5628d5aa31a0 2024-09-16T14:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.338+0000 7f54ae881780 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5628d58f2bb0 con 0x5628d5b452f0 2024-09-16T14:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.338+0000 7f54ae881780 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5628d58ffb00 con 0x5628d5b38cf0 2024-09-16T14:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54acbb7700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x5628d5b38cf0 0x5628d5b39150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51584/0 (socket says 172.21.15.73:51584) 2024-09-16T14:37:15.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54acbb7700 1 -- 172.21.15.73:0/2885287257 learned_addr learned my addr 172.21.15.73:0/2885287257 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209833167 0 0) 0x5628d58ffb00 con 0x5628d5b38cf0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5498001e10 con 0x5628d5b38cf0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082445488 0 0) 0x5628d5919ca0 con 0x5628d5aa31a0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5628d58ffb00 con 0x5628d5aa31a0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998060332 0 0) 0x5628d58f2bb0 con 0x5628d5b452f0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5628d5919ca0 con 0x5628d5b452f0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139809616 0 0) 0x7f5498001e10 con 0x5628d5b38cf0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 >> v1:172.21.15.177:6789/0 conn(0x5628d5b452f0 legacy=0x5628d5b476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 >> v1:172.21.15.73:6789/0 conn(0x5628d5aa31a0 legacy=0x5628d5b3efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628d58f2f40 con 0x5628d5b38cf0 2024-09-16T14:37:15.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4001610 con 0x5628d5b38cf0 2024-09-16T14:37:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54a4001880 con 0x5628d5b38cf0 2024-09-16T14:37:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f549ffff700 1 -- 172.21.15.73:0/2885287257 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4001c10 con 0x5628d5b38cf0 2024-09-16T14:37:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54ae881780 1 -- 172.21.15.73:0/2885287257 >> v1:172.21.15.73:6790/0 conn(0x5628d5b38cf0 legacy=0x5628d5b39150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54ae881780 1 -- 172.21.15.73:0/2885287257 shutdown_connections 2024-09-16T14:37:15.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54ae881780 1 -- 172.21.15.73:0/2885287257 >> 172.21.15.73:0/2885287257 conn(0x5628d5a819a0 msgr2=0x5628d5ab16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54ae881780 1 -- 172.21.15.73:0/2885287257 shutdown_connections 2024-09-16T14:37:15.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.342+0000 7f54ae881780 1 -- 172.21.15.73:0/2885287257 wait complete. 2024-09-16T14:37:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae881780 1 Processor -- start 2024-09-16T14:37:15.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae881780 1 -- start start 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae881780 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5628d58f29a0 con 0x5628d5b452f0 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae881780 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5628d5b3acb0 con 0x5628d5aa31a0 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae881780 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x5628d5b4e610 con 0x5628d5b38cf0 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae61a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x5628d5b452f0 0x5628d5b554a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46912/0 (socket says 172.21.15.73:46912) 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54acbb7700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x5628d5b38cf0 0x5628d5b4df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51598/0 (socket says 172.21.15.73:51598) 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.346+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 learned_addr learned my addr 172.21.15.73:0/1969407231 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:15.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885951541 0 0) 0x5628d58f29a0 con 0x5628d5b452f0 2024-09-16T14:37:15.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5490001e10 con 0x5628d5b452f0 2024-09-16T14:37:15.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111311392 0 0) 0x5628d5b4e610 con 0x5628d5b38cf0 2024-09-16T14:37:15.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5628d58f29a0 con 0x5628d5b38cf0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496173068 0 0) 0x5628d5b3acb0 con 0x5628d5aa31a0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x5628d5b4e610 con 0x5628d5aa31a0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2158031728 0 0) 0x5628d58f29a0 con 0x5628d5b38cf0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x5628d5b3acb0 con 0x5628d5b38cf0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4001b90 con 0x5628d5b38cf0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3613307798 0 0) 0x5628d5b3acb0 con 0x5628d5b38cf0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 >> v1:172.21.15.177:6789/0 conn(0x5628d5aa31a0 legacy=0x5628d5b3c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 >> v1:172.21.15.73:6789/0 conn(0x5628d5b452f0 legacy=0x5628d5b554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628d5b4e7a0 con 0x5628d5b38cf0 2024-09-16T14:37:15.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628d5b3beb0 con 0x5628d5b38cf0 2024-09-16T14:37:15.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54a4003380 con 0x5628d5b38cf0 2024-09-16T14:37:15.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4003710 con 0x5628d5b38cf0 2024-09-16T14:37:15.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x5628d5b36070 con 0x5628d5b38cf0 2024-09-16T14:37:15.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.350+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 4) v1 ==== 86001+0+0 (unknown 1350192129 0 0) 0x7f54a4003870 con 0x5628d5b38cf0 2024-09-16T14:37:15.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.354+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(16..16 src has 1..16) v4 ==== 4079+0+0 (unknown 3038059502 0 0) 0x7f54a407df90 con 0x5628d5b38cf0 2024-09-16T14:37:15.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:15.354+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x5628d5b56dd0 con 0x5628d5b38cf0 2024-09-16T14:37:16.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.282+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 141+0+0 (unknown 1851909647 0 0) 0x7f54a404b840 con 0x5628d5b38cf0 2024-09-16T14:37:16.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.282+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x5628d5918dd0 con 0x5628d5b38cf0 2024-09-16T14:37:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.290+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (unknown 391748328 0 0) 0x7f54a404b840 con 0x5628d5b38cf0 2024-09-16T14:37:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.290+0000 7f549f7fe700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=17}) v3 -- 0x7f5488002ae0 con 0x5628d5b38cf0 2024-09-16T14:37:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.290+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 11 ==== osd_map(17..17 src has 1..17) v4 ==== 658+0+0 (unknown 2443863536 0 0) 0x7f54a404f590 con 0x5628d5b38cf0 2024-09-16T14:37:16.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.290+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6812/1569396656 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) v8 -- 0x5628d5b5b5e0 con 0x5628d5b57ad0 2024-09-16T14:37:16.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.782+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 <== osd.3 v1:172.21.15.73:6812/1569396656 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) v8 ==== 153+0+0 (unknown 1703302865 0 0) 0x7f54a8001e10 con 0x5628d5b57ad0 2024-09-16T14:37:16.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.786+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6812/1569396656 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5628d5bab630 con 0x5628d5b57ad0 2024-09-16T14:37:16.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.786+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 <== osd.3 v1:172.21.15.73:6812/1569396656 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 4274215525 0 0) 0x7f54a8001e10 con 0x5628d5b57ad0 2024-09-16T14:37:16.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.786+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6812/1569396656 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) v8 -- 0x5628d5baa740 con 0x5628d5b57ad0 2024-09-16T14:37:16.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.786+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 <== osd.3 v1:172.21.15.73:6812/1569396656 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 4287864937 0 0) 0x7f54a8001e10 con 0x5628d5b57ad0 2024-09-16T14:37:16.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:16.786+0000 7f549effd700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) v4 -- 0x7f548c001f20 con 0x5628d5b38cf0 2024-09-16T14:37:17.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.302+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 12 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f54a404bc10 con 0x5628d5b38cf0 2024-09-16T14:37:17.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.306+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 13 ==== pool_op_reply(tid 4 (0) Success v18) v1 ==== 55+0+0 (unknown 2222216542 0 0) 0x7f54a4003570 con 0x5628d5b38cf0 2024-09-16T14:37:17.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.306+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=18}) v3 -- 0x5628d5b3acb0 con 0x5628d5b38cf0 2024-09-16T14:37:17.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.306+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 14 ==== osd_map(18..18 src has 1..18) v4 ==== 626+0+0 (unknown 4189185149 0 0) 0x7f54a4056290 con 0x5628d5b38cf0 2024-09-16T14:37:17.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.306+0000 7f549f7fe700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6812/1569396656 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) v8 -- 0x7f5488005600 con 0x5628d5b57ad0 2024-09-16T14:37:17.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.310+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 <== osd.3 v1:172.21.15.73:6812/1569396656 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) v8 ==== 194+0+0 (unknown 2910594948 0 0) 0x7f54a8001e10 con 0x5628d5b57ad0 2024-09-16T14:37:17.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:17.310+0000 7f549effd700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) v4 -- 0x7f548c0033b0 con 0x5628d5b38cf0 2024-09-16T14:37:18.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.302+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 15 ==== pool_op_reply(tid 6 (0) Success v19) v1 ==== 43+0+0 (unknown 3018548132 0 0) 0x7f54a40019f0 con 0x5628d5b38cf0 2024-09-16T14:37:18.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.302+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=19}) v3 -- 0x7f5490001e10 con 0x5628d5b38cf0 2024-09-16T14:37:18.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.302+0000 7f549d7fa700 1 -- 172.21.15.73:0/1969407231 <== mon.2 v1:172.21.15.73:6790/0 16 ==== osd_map(19..19 src has 1..19) v4 ==== 654+0+0 (unknown 4158164033 0 0) 0x7f54a40759c0 con 0x5628d5b38cf0 2024-09-16T14:37:18.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.302+0000 7f549f7fe700 1 -- 172.21.15.73:0/1969407231 --> v1:172.21.15.73:6812/1569396656 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) v8 -- 0x7f54880059b0 con 0x5628d5b57ad0 2024-09-16T14:37:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 <== osd.3 v1:172.21.15.73:6812/1569396656 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) v8 ==== 152+0+0 (unknown 900577457 0 0) 0x7f54a8001e10 con 0x5628d5b57ad0 2024-09-16T14:37:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 >> v1:172.21.15.73:6812/1569396656 conn(0x5628d5b57ad0 legacy=0x5628d5b59ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 >> v1:172.21.15.177:6816/2823028339 conn(0x7f5490065a80 legacy=0x7f5490067f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 >> v1:172.21.15.73:6790/0 conn(0x5628d5b38cf0 legacy=0x5628d5b4df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae61a700 1 -- 172.21.15.73:0/1969407231 reap_dead start 2024-09-16T14:37:18.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 shutdown_connections 2024-09-16T14:37:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 >> 172.21.15.73:0/1969407231 conn(0x5628d5a819a0 msgr2=0x5628d5a7d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 shutdown_connections 2024-09-16T14:37:18.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.310+0000 7f54ae881780 1 -- 172.21.15.73:0/1969407231 wait complete. 2024-09-16T14:37:18.320 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T14:37:18.321 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T14:37:18.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T14:37:18.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T14:37:18.322 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T14:37:18.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f2151d01700 1 Processor -- start 2024-09-16T14:37:18.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f2151d01700 1 -- start start 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f2151d01700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0ac090 con 0x7f214c0aeca0 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f2151d01700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0aca40 con 0x7f214c13a840 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f2151d01700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0aab80 con 0x7f214c0ac4b0 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f214bfff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f214c0ac4b0 0x7f214c0a9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51614/0 (socket says 172.21.15.73:51614) 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f214bfff700 1 -- 172.21.15.73:0/2889365529 learned_addr learned my addr 172.21.15.73:0/2889365529 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403220374 0 0) 0x7f214c0aab80 con 0x7f214c0ac4b0 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.430+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21380035d0 con 0x7f214c0ac4b0 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172879380 0 0) 0x7f214c0ac090 con 0x7f214c0aeca0 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c0aab80 con 0x7f214c0aeca0 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747694230 0 0) 0x7f214c0aca40 con 0x7f214c13a840 2024-09-16T14:37:18.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c0ac090 con 0x7f214c13a840 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535148454 0 0) 0x7f21380035d0 con 0x7f214c0ac4b0 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 >> v1:172.21.15.177:6789/0 conn(0x7f214c13a840 legacy=0x7f214c0aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 >> v1:172.21.15.73:6789/0 conn(0x7f214c0aeca0 legacy=0x7f214c13a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0aad10 con 0x7f214c0ac4b0 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f213c001990 con 0x7f214c0ac4b0 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f213c001c70 con 0x7f214c0ac4b0 2024-09-16T14:37:18.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f214b7fe700 1 -- 172.21.15.73:0/2889365529 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f213c002000 con 0x7f214c0ac4b0 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 -- 172.21.15.73:0/2889365529 >> v1:172.21.15.73:6790/0 conn(0x7f214c0ac4b0 legacy=0x7f214c0a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 -- 172.21.15.73:0/2889365529 shutdown_connections 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 -- 172.21.15.73:0/2889365529 >> 172.21.15.73:0/2889365529 conn(0x7f214c0af290 msgr2=0x7f214c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 -- 172.21.15.73:0/2889365529 shutdown_connections 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 -- 172.21.15.73:0/2889365529 wait complete. 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 Processor -- start 2024-09-16T14:37:18.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.434+0000 7f2151d01700 1 -- start start 2024-09-16T14:37:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2151d01700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c06dae0 con 0x7f214c13a840 2024-09-16T14:37:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2151d01700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c1d5850 con 0x7f214c0aeca0 2024-09-16T14:37:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2151d01700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c071e70 con 0x7f214c0ac4b0 2024-09-16T14:37:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2150cff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f214c0ac4b0 0x7f214c071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51624/0 (socket says 172.21.15.73:51624) 2024-09-16T14:37:18.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2150cff700 1 -- 172.21.15.73:0/981070043 learned_addr learned my addr 172.21.15.73:0/981070043 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341627048 0 0) 0x7f214c071e70 con 0x7f214c0ac4b0 2024-09-16T14:37:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212c0035d0 con 0x7f214c0ac4b0 2024-09-16T14:37:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989120701 0 0) 0x7f214c06dae0 con 0x7f214c13a840 2024-09-16T14:37:18.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c071e70 con 0x7f214c13a840 2024-09-16T14:37:18.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962403159 0 0) 0x7f214c1d5850 con 0x7f214c0aeca0 2024-09-16T14:37:18.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c06dae0 con 0x7f214c0aeca0 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2427199988 0 0) 0x7f212c0035d0 con 0x7f214c0ac4b0 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f214c1d5850 con 0x7f214c0ac4b0 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1887702858 0 0) 0x7f214c071e70 con 0x7f214c13a840 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f212c0035d0 con 0x7f214c13a840 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f21340018b0 con 0x7f214c0ac4b0 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2144001790 con 0x7f214c13a840 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 142062615 0 0) 0x7f212c0035d0 con 0x7f214c13a840 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 >> v1:172.21.15.73:6790/0 conn(0x7f214c0ac4b0 legacy=0x7f214c071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 >> v1:172.21.15.177:6789/0 conn(0x7f214c0aeca0 legacy=0x7f214c1d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c072000 con 0x7f214c13a840 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c140060 con 0x7f214c13a840 2024-09-16T14:37:18.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c13d600 con 0x7f214c13a840 2024-09-16T14:37:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2144001d00 con 0x7f214c13a840 2024-09-16T14:37:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.438+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2144003860 con 0x7f214c13a840 2024-09-16T14:37:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.442+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2130005100 con 0x7f214c13a840 2024-09-16T14:37:18.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.442+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f2144003a40 con 0x7f214c13a840 2024-09-16T14:37:18.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.442+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f214407e120 con 0x7f214c13a840 2024-09-16T14:37:18.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.450+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f214404b9e0 con 0x7f214c13a840 2024-09-16T14:37:18.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.654+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f21300053b0 con 0x7f214c13a840 2024-09-16T14:37:18.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.662+0000 7f21497fa700 1 -- 172.21.15.73:0/981070043 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164845 (unknown 481731318 0 1321523672) 0x7f214404d910 con 0x7f214c13a840 2024-09-16T14:37:18.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:18.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.666+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 >> v1:172.21.15.177:6816/2823028339 conn(0x7f212c067370 legacy=0x7f212c069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.666+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 >> v1:172.21.15.73:6789/0 conn(0x7f214c13a840 legacy=0x7f214c1d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.666+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 shutdown_connections 2024-09-16T14:37:18.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.666+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 >> 172.21.15.73:0/981070043 conn(0x7f214c0af290 msgr2=0x7f214c136730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:18.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.666+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 shutdown_connections 2024-09-16T14:37:18.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.666+0000 7f2151d01700 1 -- 172.21.15.73:0/981070043 wait complete. 2024-09-16T14:37:18.682 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6816","nonce":2823028339}]},"active_addr":"172.21.15.177:6816/2823028339","active_change":"2024-09-16T14:37:09.134298+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3889515466}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3874474130}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":514284205}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3767617687}]}]} 2024-09-16T14:37:18.686 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T14:37:18.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T14:37:18.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:37:18.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3bebfff700 1 Processor -- start 2024-09-16T14:37:18.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3bebfff700 1 -- start start 2024-09-16T14:37:18.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3bebfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0af3e0 con 0x7f3bec0acca0 2024-09-16T14:37:18.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3bebfff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec0ad0d0 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3bebfff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec06b150 con 0x7f3bec0b0d20 2024-09-16T14:37:18.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3beaffd700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f3bec0b0d20 0x7f3bec0af870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51628/0 (socket says 172.21.15.73:51628) 2024-09-16T14:37:18.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3beaffd700 1 -- 172.21.15.73:0/2485762421 learned_addr learned my addr 172.21.15.73:0/2485762421 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062200484 0 0) 0x7f3bec06b150 con 0x7f3bec0b0d20 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd40035d0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030768701 0 0) 0x7f3bec0af3e0 con 0x7f3bec0acca0 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bec06b150 con 0x7f3bec0acca0 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.794+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613380725 0 0) 0x7f3bec0ad0d0 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bec0af3e0 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1521476985 0 0) 0x7f3bd40035d0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 >> v1:172.21.15.177:6789/0 conn(0x7f3bec0ad3d0 legacy=0x7f3bec0ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 >> v1:172.21.15.73:6789/0 conn(0x7f3bec0acca0 legacy=0x7f3bec14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec06b2e0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3bdc001610 con 0x7f3bec0b0d20 2024-09-16T14:37:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3bdc001880 con 0x7f3bec0b0d20 2024-09-16T14:37:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3be9ffb700 1 -- 172.21.15.73:0/2485762421 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3bdc001c10 con 0x7f3bec0b0d20 2024-09-16T14:37:18.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- 172.21.15.73:0/2485762421 >> v1:172.21.15.73:6790/0 conn(0x7f3bec0b0d20 legacy=0x7f3bec0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- 172.21.15.73:0/2485762421 shutdown_connections 2024-09-16T14:37:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- 172.21.15.73:0/2485762421 >> 172.21.15.73:0/2485762421 conn(0x7f3bec0b3ed0 msgr2=0x7f3bec0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- 172.21.15.73:0/2485762421 shutdown_connections 2024-09-16T14:37:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- 172.21.15.73:0/2485762421 wait complete. 2024-09-16T14:37:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 Processor -- start 2024-09-16T14:37:18.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- start start 2024-09-16T14:37:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec11b480 con 0x7f3bec0b0d20 2024-09-16T14:37:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec1d3c50 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.798+0000 7f3bebfff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bec1d37c0 con 0x7f3bec0acca0 2024-09-16T14:37:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3beaffd700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f3bec0acca0 0x7f3bec1d4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51640/0 (socket says 172.21.15.73:51640) 2024-09-16T14:37:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3beaffd700 1 -- 172.21.15.73:0/1044490736 learned_addr learned my addr 172.21.15.73:0/1044490736 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:18.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3beaffd700 1 -- 172.21.15.73:0/1044490736 >> v1:172.21.15.73:6790/0 conn(0x7f3bec0acca0 legacy=0x7f3bec1d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3beaffd700 1 -- 172.21.15.73:0/1044490736 >> v1:172.21.15.73:6790/0 conn(0x7f3bec0acca0 legacy=0x7f3bec1d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3beaffd700 1 --1- 172.21.15.73:0/1044490736 >> v1:172.21.15.73:6790/0 conn(0x7f3bec0acca0 0x7f3bec1d4170 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3beaffd700 1 --1- 172.21.15.73:0/1044490736 >> v1:172.21.15.73:6790/0 conn(0x7f3bec0acca0 0x7f3bec1d4170 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120019807 0 0) 0x7f3bec11b480 con 0x7f3bec0b0d20 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd80035d0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216163821 0 0) 0x7f3bec1d3c50 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bec11b480 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 162035007 0 0) 0x7f3bd80035d0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3bec1d3c50 con 0x7f3bec0b0d20 2024-09-16T14:37:18.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3be4001b30 con 0x7f3bec0b0d20 2024-09-16T14:37:18.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3338928256 0 0) 0x7f3bec11b480 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3bd80035d0 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3be00018f0 con 0x7f3bec0ad3d0 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2551805326 0 0) 0x7f3bec1d3c50 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 >> v1:172.21.15.73:6790/0 conn(0x7f3bec0acca0 legacy=0x7f3bec1d4170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 >> v1:172.21.15.177:6789/0 conn(0x7f3bec0ad3d0 legacy=0x7f3bec0a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec1d3950 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec13a1e0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec139790 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3be4002080 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3be4003be0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc005100 con 0x7f3bec0b0d20 2024-09-16T14:37:18.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.802+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f3be4018d80 con 0x7f3bec0b0d20 2024-09-16T14:37:18.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.806+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f3be407e4e0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.810+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f3be404bbd0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.978+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bcc0053b0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.982+0000 7f3bd37fe700 1 -- 172.21.15.73:0/1044490736 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12806 (unknown 941590788 0 1712156961) 0x7f3be404dcd0 con 0x7f3bec0b0d20 2024-09-16T14:37:18.986 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:18.986 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"00a48c31-0009-4414-a6e8-5009f0ad4af8","created":"2024-09-16T14:37:03.904421+0000","modified":"2024-09-16T14:37:18.297935+0000","last_up_change":"2024-09-16T14:37:13.233269+0000","last_in_change":"2024-09-16T14:37:05.980210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T14:37:13.207309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T14:37:14.708831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d48450e-baaa-42ad-93b9-30c34ec79d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3200602632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3200602632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3200602632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3200602632}]},"public_addr":"172.21.15.73:6804/3200602632","cluster_addr":"172.21.15.73:6805/3200602632","heartbeat_back_addr":"172.21.15.73:6807/3200602632","heartbeat_front_addr":"172.21.15.73:6806/3200602632","state":["exists","up"]},{"osd":1,"uuid":"58e40796-3999-48ed-a83f-ad57036a99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":342316973}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":342316973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":342316973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":342316973}]},"public_addr":"172.21.15.73:6808/342316973","cluster_addr":"172.21.15.73:6809/342316973","heartbeat_back_addr":"172.21.15.73:6811/342316973","heartbeat_front_addr":"172.21.15.73:6810/342316973","state":["exists","up"]},{"osd":2,"uuid":"53fdea0d-c928-4266-bfc7-9fbd991a9fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":303375583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":303375583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":303375583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":303375583}]},"public_addr":"172.21.15.73:6800/303375583","cluster_addr":"172.21.15.73:6801/303375583","heartbeat_back_addr":"172.21.15.73:6803/303375583","heartbeat_front_addr":"172.21.15.73:6802/303375583","state":["exists","up"]},{"osd":3,"uuid":"fbf3a6da-fa7d-4901-86bd-fe8c90665a54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":1569396656}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":1569396656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":1569396656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":1569396656}]},"public_addr":"172.21.15.73:6812/1569396656","cluster_addr":"172.21.15.73:6813/1569396656","heartbeat_back_addr":"172.21.15.73:6815/1569396656","heartbeat_front_addr":"172.21.15.73:6814/1569396656","state":["exists","up"]},{"osd":4,"uuid":"f493a27b-6fca-494f-9031-d13e97c866e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6801","nonce":573978299}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6803","nonce":573978299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6807","nonce":573978299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6805","nonce":573978299}]},"public_addr":"172.21.15.177:6801/573978299","cluster_addr":"172.21.15.177:6803/573978299","heartbeat_back_addr":"172.21.15.177:6807/573978299","heartbeat_front_addr":"172.21.15.177:6805/573978299","state":["exists","up"]},{"osd":5,"uuid":"076a5b78-a7c6-4897-8381-dd264f4f4be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6809","nonce":702447135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6811","nonce":702447135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6815","nonce":702447135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6813","nonce":702447135}]},"public_addr":"172.21.15.177:6809/702447135","cluster_addr":"172.21.15.177:6811/702447135","heartbeat_back_addr":"172.21.15.177:6815/702447135","heartbeat_front_addr":"172.21.15.177:6813/702447135","state":["exists","up"]},{"osd":6,"uuid":"50df42c8-9444-4f81-acd2-68b6f84acd9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6800","nonce":877193733}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6802","nonce":877193733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6806","nonce":877193733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6804","nonce":877193733}]},"public_addr":"172.21.15.177:6800/877193733","cluster_addr":"172.21.15.177:6802/877193733","heartbeat_back_addr":"172.21.15.177:6806/877193733","heartbeat_front_addr":"172.21.15.177:6804/877193733","state":["exists","up"]},{"osd":7,"uuid":"2850af42-0ef9-4516-bdf0-2dc6119b1fb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6808","nonce":3844040909}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6810","nonce":3844040909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6814","nonce":3844040909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6812","nonce":3844040909}]},"public_addr":"172.21.15.177:6808/3844040909","cluster_addr":"172.21.15.177:6810/3844040909","heartbeat_back_addr":"172.21.15.177:6814/3844040909","heartbeat_front_addr":"172.21.15.177:6812/3844040909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.217458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.306016+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.250219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.823535+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.942853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.045593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.231206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.777308+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:37:18.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.986+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 >> v1:172.21.15.177:6816/2823028339 conn(0x7f3bd80672f0 legacy=0x7f3bd80697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.986+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 >> v1:172.21.15.73:6789/0 conn(0x7f3bec0b0d20 legacy=0x7f3bec139080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.986+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 shutdown_connections 2024-09-16T14:37:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.986+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 >> 172.21.15.73:0/1044490736 conn(0x7f3bec0b3ed0 msgr2=0x7f3bec13b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.986+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 shutdown_connections 2024-09-16T14:37:18.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:18.986+0000 7f3bebfff700 1 -- 172.21.15.73:0/1044490736 wait complete. 2024-09-16T14:37:19.001 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T14:37:19.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:37:19.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.110+0000 7f6179653700 1 Processor -- start 2024-09-16T14:37:19.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.110+0000 7f6179653700 1 -- start start 2024-09-16T14:37:19.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c02dfa0 con 0x7f616c02ead0 2024-09-16T14:37:19.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c02c450 con 0x7f616c0c2a90 2024-09-16T14:37:19.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c00b450 con 0x7f616c0064b0 2024-09-16T14:37:19.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f61737fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f616c02ead0 0x7f616c0c2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46960/0 (socket says 172.21.15.73:46960) 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f61737fe700 1 -- 172.21.15.73:0/2610709177 learned_addr learned my addr 172.21.15.73:0/2610709177 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660602736 0 0) 0x7f616c02dfa0 con 0x7f616c02ead0 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61640035d0 con 0x7f616c02ead0 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566109275 0 0) 0x7f616c00b450 con 0x7f616c0064b0 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c02dfa0 con 0x7f616c0064b0 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203178373 0 0) 0x7f616c02c450 con 0x7f616c0c2a90 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c00b450 con 0x7f616c0c2a90 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 359826860 0 0) 0x7f61640035d0 con 0x7f616c02ead0 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 >> v1:172.21.15.73:6790/0 conn(0x7f616c0064b0 legacy=0x7f616c02e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 >> v1:172.21.15.177:6789/0 conn(0x7f616c0c2a90 legacy=0x7f616c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c030300 con 0x7f616c02ead0 2024-09-16T14:37:19.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6160001610 con 0x7f616c02ead0 2024-09-16T14:37:19.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f61600018f0 con 0x7f616c02ead0 2024-09-16T14:37:19.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6172ffd700 1 -- 172.21.15.73:0/2610709177 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6160001cc0 con 0x7f616c02ead0 2024-09-16T14:37:19.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- 172.21.15.73:0/2610709177 >> v1:172.21.15.73:6789/0 conn(0x7f616c02ead0 legacy=0x7f616c0c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- 172.21.15.73:0/2610709177 shutdown_connections 2024-09-16T14:37:19.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- 172.21.15.73:0/2610709177 >> 172.21.15.73:0/2610709177 conn(0x7f616c005510 msgr2=0x7f616c005920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- 172.21.15.73:0/2610709177 shutdown_connections 2024-09-16T14:37:19.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 -- 172.21.15.73:0/2610709177 wait complete. 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.114+0000 7f6179653700 1 Processor -- start 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- start start 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c0c4930 con 0x7f616c0c2a90 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c02a6d0 con 0x7f616c02ead0 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c0c3870 con 0x7f616c0064b0 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6173fff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f616c0064b0 0x7f616c0c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51656/0 (socket says 172.21.15.73:51656) 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6173fff700 1 -- 172.21.15.73:0/1669348921 learned_addr learned my addr 172.21.15.73:0/1669348921 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6178e52700 1 --1- 172.21.15.73:0/1669348921 >> v1:172.21.15.73:6789/0 conn(0x7f616c0c2a90 0x7f616c15a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46972/0 (socket says 172.21.15.73:46972) 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937736794 0 0) 0x7f616c0c4930 con 0x7f616c0c2a90 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61580035d0 con 0x7f616c0c2a90 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606964955 0 0) 0x7f616c02a6d0 con 0x7f616c02ead0 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c0c4930 con 0x7f616c02ead0 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798723222 0 0) 0x7f616c0c3870 con 0x7f616c0064b0 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f616c02a6d0 con 0x7f616c0064b0 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 476960502 0 0) 0x7f61580035d0 con 0x7f616c0c2a90 2024-09-16T14:37:19.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f616c0c3870 con 0x7f616c0c2a90 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6174069410 con 0x7f616c0c2a90 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2115726029 0 0) 0x7f616c0c4930 con 0x7f616c02ead0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61580035d0 con 0x7f616c02ead0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f61600015d0 con 0x7f616c02ead0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1999257307 0 0) 0x7f616c02a6d0 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f616c0c4930 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f61680018d0 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3655696533 0 0) 0x7f616c0c4930 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 >> v1:172.21.15.177:6789/0 conn(0x7f616c02ead0 legacy=0x7f616c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 >> v1:172.21.15.73:6789/0 conn(0x7f616c0c2a90 legacy=0x7f616c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c0c4fc0 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c02b2a0 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c0c5e70 con 0x7f616c0064b0 2024-09-16T14:37:19.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f61680036a0 con 0x7f616c0064b0 2024-09-16T14:37:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6168003a30 con 0x7f616c0064b0 2024-09-16T14:37:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.118+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6154005100 con 0x7f616c0064b0 2024-09-16T14:37:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.122+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f6168003c10 con 0x7f616c0064b0 2024-09-16T14:37:19.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.122+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f616807f5a0 con 0x7f616c0064b0 2024-09-16T14:37:19.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.126+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f616804cd20 con 0x7f616c0064b0 2024-09-16T14:37:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.306+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61540053b0 con 0x7f616c0064b0 2024-09-16T14:37:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.310+0000 7f6170ff9700 1 -- 172.21.15.73:0/1669348921 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12806 (unknown 941590788 0 1712156961) 0x7f616804ec50 con 0x7f616c0064b0 2024-09-16T14:37:19.316 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:19.316 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":19,"fsid":"00a48c31-0009-4414-a6e8-5009f0ad4af8","created":"2024-09-16T14:37:03.904421+0000","modified":"2024-09-16T14:37:18.297935+0000","last_up_change":"2024-09-16T14:37:13.233269+0000","last_in_change":"2024-09-16T14:37:05.980210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T14:37:13.207309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T14:37:14.708831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d48450e-baaa-42ad-93b9-30c34ec79d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3200602632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3200602632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3200602632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3200602632}]},"public_addr":"172.21.15.73:6804/3200602632","cluster_addr":"172.21.15.73:6805/3200602632","heartbeat_back_addr":"172.21.15.73:6807/3200602632","heartbeat_front_addr":"172.21.15.73:6806/3200602632","state":["exists","up"]},{"osd":1,"uuid":"58e40796-3999-48ed-a83f-ad57036a99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":342316973}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":342316973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":342316973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":342316973}]},"public_addr":"172.21.15.73:6808/342316973","cluster_addr":"172.21.15.73:6809/342316973","heartbeat_back_addr":"172.21.15.73:6811/342316973","heartbeat_front_addr":"172.21.15.73:6810/342316973","state":["exists","up"]},{"osd":2,"uuid":"53fdea0d-c928-4266-bfc7-9fbd991a9fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":303375583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":303375583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":303375583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":303375583}]},"public_addr":"172.21.15.73:6800/303375583","cluster_addr":"172.21.15.73:6801/303375583","heartbeat_back_addr":"172.21.15.73:6803/303375583","heartbeat_front_addr":"172.21.15.73:6802/303375583","state":["exists","up"]},{"osd":3,"uuid":"fbf3a6da-fa7d-4901-86bd-fe8c90665a54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":1569396656}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":1569396656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":1569396656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":1569396656}]},"public_addr":"172.21.15.73:6812/1569396656","cluster_addr":"172.21.15.73:6813/1569396656","heartbeat_back_addr":"172.21.15.73:6815/1569396656","heartbeat_front_addr":"172.21.15.73:6814/1569396656","state":["exists","up"]},{"osd":4,"uuid":"f493a27b-6fca-494f-9031-d13e97c866e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6801","nonce":573978299}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6803","nonce":573978299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6807","nonce":573978299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6805","nonce":573978299}]},"public_addr":"172.21.15.177:6801/573978299","cluster_addr":"172.21.15.177:6803/573978299","heartbeat_back_addr":"172.21.15.177:6807/573978299","heartbeat_front_addr":"172.21.15.177:6805/573978299","state":["exists","up"]},{"osd":5,"uuid":"076a5b78-a7c6-4897-8381-dd264f4f4be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6809","nonce":702447135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6811","nonce":702447135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6815","nonce":702447135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6813","nonce":702447135}]},"public_addr":"172.21.15.177:6809/702447135","cluster_addr":"172.21.15.177:6811/702447135","heartbeat_back_addr":"172.21.15.177:6815/702447135","heartbeat_front_addr":"172.21.15.177:6813/702447135","state":["exists","up"]},{"osd":6,"uuid":"50df42c8-9444-4f81-acd2-68b6f84acd9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6800","nonce":877193733}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6802","nonce":877193733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6806","nonce":877193733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6804","nonce":877193733}]},"public_addr":"172.21.15.177:6800/877193733","cluster_addr":"172.21.15.177:6802/877193733","heartbeat_back_addr":"172.21.15.177:6806/877193733","heartbeat_front_addr":"172.21.15.177:6804/877193733","state":["exists","up"]},{"osd":7,"uuid":"2850af42-0ef9-4516-bdf0-2dc6119b1fb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6808","nonce":3844040909}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6810","nonce":3844040909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6814","nonce":3844040909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6812","nonce":3844040909}]},"public_addr":"172.21.15.177:6808/3844040909","cluster_addr":"172.21.15.177:6810/3844040909","heartbeat_back_addr":"172.21.15.177:6814/3844040909","heartbeat_front_addr":"172.21.15.177:6812/3844040909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.217458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.306016+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.250219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.823535+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.942853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.045593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.231206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.777308+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:37:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.314+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 >> v1:172.21.15.177:6816/2823028339 conn(0x7f6158067480 legacy=0x7f6158069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.314+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 >> v1:172.21.15.73:6790/0 conn(0x7f616c0064b0 legacy=0x7f616c0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.314+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 shutdown_connections 2024-09-16T14:37:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.314+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 >> 172.21.15.73:0/1669348921 conn(0x7f616c005510 msgr2=0x7f616c0ba0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.314+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 shutdown_connections 2024-09-16T14:37:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.314+0000 7f6179653700 1 -- 172.21.15.73:0/1669348921 wait complete. 2024-09-16T14:37:19.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T14:37:19.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T14:37:19.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T14:37:19.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T14:37:19.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T14:37:19.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T14:37:19.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T14:37:19.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T14:37:19.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d3512d700 1 Processor -- start 2024-09-16T14:37:19.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d3512d700 1 -- start start 2024-09-16T14:37:19.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d3512d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300ab270 con 0x7f8d301452e0 2024-09-16T14:37:19.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d3512d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300ab550 con 0x7f8d30142c90 2024-09-16T14:37:19.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d3512d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300ac0a0 con 0x7f8d300ae410 2024-09-16T14:37:19.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8d301452e0 0x7f8d30142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46974/0 (socket says 172.21.15.73:46974) 2024-09-16T14:37:19.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2f7fe700 1 -- 172.21.15.73:0/2105841844 learned_addr learned my addr 172.21.15.73:0/2105841844 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562768036 0 0) 0x7f8d300ac0a0 con 0x7f8d300ae410 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d180035d0 con 0x7f8d300ae410 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478169974 0 0) 0x7f8d300ab270 con 0x7f8d301452e0 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d300ac0a0 con 0x7f8d301452e0 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412961318 0 0) 0x7f8d300ab550 con 0x7f8d30142c90 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d300ab270 con 0x7f8d30142c90 2024-09-16T14:37:19.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2744009593 0 0) 0x7f8d300ac0a0 con 0x7f8d301452e0 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 >> v1:172.21.15.73:6790/0 conn(0x7f8d300ae410 legacy=0x7f8d300ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 >> v1:172.21.15.177:6789/0 conn(0x7f8d30142c90 legacy=0x7f8d30150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30145750 con 0x7f8d301452e0 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8d28001970 con 0x7f8d301452e0 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8d28001b90 con 0x7f8d301452e0 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.482+0000 7f8d2effd700 1 -- 172.21.15.73:0/2105841844 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8d28001fa0 con 0x7f8d301452e0 2024-09-16T14:37:19.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 -- 172.21.15.73:0/2105841844 >> v1:172.21.15.73:6789/0 conn(0x7f8d301452e0 legacy=0x7f8d30142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b63b3700 1 Processor -- start 2024-09-16T14:37:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b63b3700 1 -- start start 2024-09-16T14:37:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1b59e700 1 Processor -- start 2024-09-16T14:37:19.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1b59e700 1 -- start start 2024-09-16T14:37:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c2736700 1 Processor -- start 2024-09-16T14:37:19.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52707a2700 1 Processor -- start 2024-09-16T14:37:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c2736700 1 -- start start 2024-09-16T14:37:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 -- 172.21.15.73:0/2105841844 shutdown_connections 2024-09-16T14:37:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 -- 172.21.15.73:0/2105841844 >> 172.21.15.73:0/2105841844 conn(0x7f8d300af290 msgr2=0x7f8d300af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 -- 172.21.15.73:0/2105841844 shutdown_connections 2024-09-16T14:37:19.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 -- 172.21.15.73:0/2105841844 wait complete. 2024-09-16T14:37:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b63b3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b00aa1b0 con 0x7f52b00a8f20 2024-09-16T14:37:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b63b3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b00a8a00 con 0x7f52b0144a90 2024-09-16T14:37:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b63b3700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b00aecf0 con 0x7f52b00ae410 2024-09-16T14:37:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b53b1700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f52b00ae410 0x7f52b0144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51690/0 (socket says 172.21.15.73:51690) 2024-09-16T14:37:19.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52b53b1700 1 -- 172.21.15.73:0/259513246 learned_addr learned my addr 172.21.15.73:0/259513246 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c2736700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc13f940 con 0x7f13bc0ae410 2024-09-16T14:37:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c2736700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc13ed10 con 0x7f13bc0aeea0 2024-09-16T14:37:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c2736700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc13c6b0 con 0x7f13bc13c1e0 2024-09-16T14:37:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c1f35700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 0x7f13bc14a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51694/0 (socket says 172.21.15.73:51694) 2024-09-16T14:37:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c1f35700 1 -- 172.21.15.73:0/3956437950 learned_addr learned my addr 172.21.15.73:0/3956437950 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52707a2700 1 -- start start 2024-09-16T14:37:19.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0abc50 con 0x7f3b1c1487e0 2024-09-16T14:37:19.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1b59e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0abf30 con 0x7f3b1c142b90 2024-09-16T14:37:19.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1b59e700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0acad0 con 0x7f3b1c0ae410 2024-09-16T14:37:19.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b19d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3b1c1487e0 0x7f3b1c142480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46982/0 (socket says 172.21.15.73:46982) 2024-09-16T14:37:19.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b19d9b700 1 -- 172.21.15.73:0/3674971028 learned_addr learned my addr 172.21.15.73:0/3674971028 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 Processor -- start 2024-09-16T14:37:19.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846153898 0 0) 0x7f3b1c0abc50 con 0x7f3b1c1487e0 2024-09-16T14:37:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b040035d0 con 0x7f3b1c1487e0 2024-09-16T14:37:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285228311 0 0) 0x7f52b00a8a00 con 0x7f52b0144a90 2024-09-16T14:37:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f529c0035d0 con 0x7f52b0144a90 2024-09-16T14:37:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c0f33700 1 -- 172.21.15.73:0/3956437950 >> v1:172.21.15.177:6789/0 conn(0x7f13bc0aeea0 legacy=0x7f13bc13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-16T14:37:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c0f33700 1 -- 172.21.15.73:0/3956437950 >> v1:172.21.15.177:6789/0 conn(0x7f13bc0aeea0 legacy=0x7f13bc13bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:19.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c0f33700 1 --1- 172.21.15.73:0/3956437950 >> v1:172.21.15.177:6789/0 conn(0x7f13bc0aeea0 0x7f13bc13bad0 :-1 s=OPENED pgs=86 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13c0f33700 1 --1- 172.21.15.73:0/3956437950 >> v1:172.21.15.177:6789/0 conn(0x7f13bc0aeea0 0x7f13bc13bad0 :-1 s=OPENED pgs=86 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744385765 0 0) 0x7f3b1c0acad0 con 0x7f3b1c0ae410 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c0abc50 con 0x7f3b1c0ae410 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f8d3512d700 1 -- start start 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3512d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d301d9ef0 con 0x7f8d300ae410 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3512d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3006d2c0 con 0x7f8d30142c90 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3512d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3006de90 con 0x7f8d301452e0 2024-09-16T14:37:19.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3492c700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8d301452e0 0x7f8d3013e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51708/0 (socket says 172.21.15.73:51708) 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327264342 0 0) 0x7f52b00aecf0 con 0x7f52b00ae410 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b00a8a00 con 0x7f52b00ae410 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1938962711 0 0) 0x7f529c0035d0 con 0x7f52b0144a90 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 >> v1:172.21.15.73:6790/0 conn(0x7f52b00ae410 legacy=0x7f52b0144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 >> v1:172.21.15.73:6789/0 conn(0x7f52b00a8f20 legacy=0x7f52b013e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b00aee80 con 0x7f52b0144a90 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f52a0001610 con 0x7f52b0144a90 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f52a00018f0 con 0x7f52b0144a90 2024-09-16T14:37:19.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52a7fff700 1 -- 172.21.15.73:0/259513246 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f52a0001c80 con 0x7f52b0144a90 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532267941 0 0) 0x7f13bc13c6b0 con 0x7f13bc13c1e0 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a80035d0 con 0x7f13bc13c1e0 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607908004 0 0) 0x7f13bc13f940 con 0x7f13bc0ae410 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13bc13c6b0 con 0x7f13bc0ae410 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1953583155 0 0) 0x7f13a80035d0 con 0x7f13bc13c1e0 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 >> v1:172.21.15.177:6789/0 conn(0x7f13bc0aeea0 legacy=0x7f13bc13bad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 >> v1:172.21.15.73:6789/0 conn(0x7f13bc0ae410 legacy=0x7f13bc13f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc072680 con 0x7f13bc13c1e0 2024-09-16T14:37:19.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f13b8001610 con 0x7f13bc13c1e0 2024-09-16T14:37:19.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52707a2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680aa1b0 con 0x7f5268144a90 2024-09-16T14:37:19.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52707a2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680a8a00 con 0x7f52680ae410 2024-09-16T14:37:19.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f52707a2700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680aecf0 con 0x7f52680a8f20 2024-09-16T14:37:19.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f526dd3d700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f52680a8f20 0x7f526813e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51698/0 (socket says 172.21.15.73:51698) 2024-09-16T14:37:19.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f526dd3d700 1 -- 172.21.15.73:0/2198107463 learned_addr learned my addr 172.21.15.73:0/2198107463 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2021700586 0 0) 0x7f3b040035d0 con 0x7f3b1c1487e0 2024-09-16T14:37:19.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 >> v1:172.21.15.73:6790/0 conn(0x7f3b1c0ae410 legacy=0x7f3b1c0ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 >> v1:172.21.15.177:6789/0 conn(0x7f3b1c142b90 legacy=0x7f3b1c150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0aaf20 con 0x7f3b1c1487e0 2024-09-16T14:37:19.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.486+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3b10001590 con 0x7f3b1c1487e0 2024-09-16T14:37:19.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3b10001820 con 0x7f3b1c1487e0 2024-09-16T14:37:19.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1959a700 1 -- 172.21.15.73:0/3674971028 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3b10001bb0 con 0x7f3b1c1487e0 2024-09-16T14:37:19.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3492c700 1 -- 172.21.15.73:0/1585198650 learned_addr learned my addr 172.21.15.73:0/1585198650 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f13b80018a0 con 0x7f13bc13c1e0 2024-09-16T14:37:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460433356 0 0) 0x7f52680aecf0 con 0x7f52680a8f20 2024-09-16T14:37:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52540035d0 con 0x7f52680a8f20 2024-09-16T14:37:19.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52b63b3700 1 -- 172.21.15.73:0/259513246 >> v1:172.21.15.177:6789/0 conn(0x7f52b0144a90 legacy=0x7f52b014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176066984 0 0) 0x7f52680a8a00 con 0x7f52680ae410 2024-09-16T14:37:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52680aecf0 con 0x7f52680ae410 2024-09-16T14:37:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544527882 0 0) 0x7f52680aa1b0 con 0x7f5268144a90 2024-09-16T14:37:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52680a8a00 con 0x7f5268144a90 2024-09-16T14:37:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845607582 0 0) 0x7f52540035d0 con 0x7f52680a8f20 2024-09-16T14:37:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329281659 0 0) 0x7f8d301d9ef0 con 0x7f8d300ae410 2024-09-16T14:37:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 >> v1:172.21.15.177:6789/0 conn(0x7f52680ae410 legacy=0x7f5268144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c0035d0 con 0x7f8d300ae410 2024-09-16T14:37:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 >> v1:172.21.15.73:6789/0 conn(0x7f5268144a90 legacy=0x7f526814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52b63b3700 1 -- 172.21.15.73:0/259513246 shutdown_connections 2024-09-16T14:37:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52b63b3700 1 -- 172.21.15.73:0/259513246 >> 172.21.15.73:0/259513246 conn(0x7f52b00af290 msgr2=0x7f52b00af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107734148 0 0) 0x7f8d3006de90 con 0x7f8d301452e0 2024-09-16T14:37:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d301d9ef0 con 0x7f8d301452e0 2024-09-16T14:37:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680aee80 con 0x7f52680a8f20 2024-09-16T14:37:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5260001990 con 0x7f52680a8f20 2024-09-16T14:37:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa2723700 1 Processor -- start 2024-09-16T14:37:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5260001c20 con 0x7f52680a8f20 2024-09-16T14:37:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 944166315 0 0) 0x7f8d1c0035d0 con 0x7f8d300ae410 2024-09-16T14:37:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d3006de90 con 0x7f8d300ae410 2024-09-16T14:37:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8d24001920 con 0x7f8d300ae410 2024-09-16T14:37:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703710010 0 0) 0x7f8d3006d2c0 con 0x7f8d30142c90 2024-09-16T14:37:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1c0035d0 con 0x7f8d30142c90 2024-09-16T14:37:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13b3fff700 1 -- 172.21.15.73:0/3956437950 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f13b8001c30 con 0x7f13bc13c1e0 2024-09-16T14:37:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f526d53c700 1 -- 172.21.15.73:0/2198107463 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5260001fb0 con 0x7f52680a8f20 2024-09-16T14:37:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 814326939 0 0) 0x7f8d301d9ef0 con 0x7f8d301452e0 2024-09-16T14:37:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8d3006d2c0 con 0x7f8d301452e0 2024-09-16T14:37:19.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8d200018f0 con 0x7f8d301452e0 2024-09-16T14:37:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13c2736700 1 -- 172.21.15.73:0/3956437950 >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 legacy=0x7f13bc14a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13c2736700 1 -- 172.21.15.73:0/3956437950 shutdown_connections 2024-09-16T14:37:19.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3674971028 >> v1:172.21.15.73:6789/0 conn(0x7f3b1c1487e0 legacy=0x7f3b1c142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3674971028 shutdown_connections 2024-09-16T14:37:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3674971028 >> 172.21.15.73:0/3674971028 conn(0x7f3b1c0af290 msgr2=0x7f3b1c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3674971028 shutdown_connections 2024-09-16T14:37:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3674971028 wait complete. 2024-09-16T14:37:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13c2736700 1 -- 172.21.15.73:0/3956437950 >> 172.21.15.73:0/3956437950 conn(0x7f13bc0af290 msgr2=0x7f13bc0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa2723700 1 -- start start 2024-09-16T14:37:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd2334ad700 1 Processor -- start 2024-09-16T14:37:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2524169565 0 0) 0x7f8d3006d2c0 con 0x7f8d301452e0 2024-09-16T14:37:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 >> v1:172.21.15.177:6789/0 conn(0x7f8d30142c90 legacy=0x7f8d3006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 >> v1:172.21.15.73:6789/0 conn(0x7f8d300ae410 legacy=0x7f8d301da410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d301dab20 con 0x7f8d301452e0 2024-09-16T14:37:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52b63b3700 1 -- 172.21.15.73:0/259513246 shutdown_connections 2024-09-16T14:37:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd2334ad700 1 -- start start 2024-09-16T14:37:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa2723700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c0ab9d0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa2723700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c0abcb0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa2723700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c0aa510 con 0x7f9f9c0ae410 2024-09-16T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa1721700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f9f9c0ae410 0x7f9f9c13a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51724/0 (socket says 172.21.15.73:51724) 2024-09-16T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f9fa1721700 1 -- 172.21.15.73:0/2887851682 learned_addr learned my addr 172.21.15.73:0/2887851682 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d30070910 con 0x7f8d301452e0 2024-09-16T14:37:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3006f010 con 0x7f8d301452e0 2024-09-16T14:37:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52b63b3700 1 -- 172.21.15.73:0/259513246 wait complete. 2024-09-16T14:37:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b63b3700 1 Processor -- start 2024-09-16T14:37:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13c2736700 1 -- 172.21.15.73:0/3956437950 shutdown_connections 2024-09-16T14:37:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f13c2736700 1 -- 172.21.15.73:0/3956437950 wait complete. 2024-09-16T14:37:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c2736700 1 Processor -- start 2024-09-16T14:37:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52707a2700 1 -- 172.21.15.73:0/2198107463 >> v1:172.21.15.73:6790/0 conn(0x7f52680a8f20 legacy=0x7f526813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52707a2700 1 -- 172.21.15.73:0/2198107463 shutdown_connections 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52707a2700 1 -- 172.21.15.73:0/2198107463 >> 172.21.15.73:0/2198107463 conn(0x7f52680af290 msgr2=0x7f52680af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52707a2700 1 -- 172.21.15.73:0/2198107463 shutdown_connections 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f52707a2700 1 -- 172.21.15.73:0/2198107463 wait complete. 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd2334ad700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0aa1b0 con 0x7fd22c0a8f20 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd2334ad700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0a8a00 con 0x7fd22c0ae410 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd2334ad700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0aecf0 con 0x7fd22c144a90 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd232cac700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fd22c144a90 0x7fd22c14c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51728/0 (socket says 172.21.15.73:51728) 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd232cac700 1 -- 172.21.15.73:0/3625896132 learned_addr learned my addr 172.21.15.73:0/3625896132 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7fd2324ab700 1 --1- 172.21.15.73:0/3625896132 >> v1:172.21.15.177:6789/0 conn(0x7fd22c0ae410 0x7fd22c144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.73:49906/0 (socket says 172.21.15.73:49906) 2024-09-16T14:37:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936440061 0 0) 0x7fd22c0aecf0 con 0x7fd22c144a90 2024-09-16T14:37:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2180035d0 con 0x7fd22c144a90 2024-09-16T14:37:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 Processor -- start 2024-09-16T14:37:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.490+0000 7f3b1b59e700 1 -- start start 2024-09-16T14:37:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b19d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3b1c142b90 0x7f3b1c13e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47028/0 (socket says 172.21.15.73:47028) 2024-09-16T14:37:19.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b19d9b700 1 -- 172.21.15.73:0/3488608456 learned_addr learned my addr 172.21.15.73:0/3488608456 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321101834 0 0) 0x7fd22c0aa1b0 con 0x7fd22c0a8f20 2024-09-16T14:37:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c0aecf0 con 0x7fd22c0a8f20 2024-09-16T14:37:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52707a2700 1 Processor -- start 2024-09-16T14:37:19.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52707a2700 1 -- start start 2024-09-16T14:37:19.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c145c60 con 0x7f3b1c142b90 2024-09-16T14:37:19.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 95230961 0 0) 0x7fd2180035d0 con 0x7fd22c144a90 2024-09-16T14:37:19.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 >> v1:172.21.15.177:6789/0 conn(0x7fd22c0ae410 legacy=0x7fd22c144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T14:37:19.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 >> v1:172.21.15.73:6789/0 conn(0x7fd22c0a8f20 legacy=0x7fd22c13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0aee80 con 0x7fd22c144a90 2024-09-16T14:37:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c143b30 con 0x7f3b1c0ae410 2024-09-16T14:37:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d300ae7f0 con 0x7f8d301452e0 2024-09-16T14:37:19.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0b2110 con 0x7f3b1c1487e0 2024-09-16T14:37:19.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd224001990 con 0x7fd22c144a90 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b63b3700 1 -- start start 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b63b3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b0141560 con 0x7f52b00ae410 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b63b3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b0137ae0 con 0x7f52b00a8f20 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b63b3700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b013b190 con 0x7f52b0144a90 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b5bb2700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f52b0144a90 0x7f52b01373d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51746/0 (socket says 172.21.15.73:51746) 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52b5bb2700 1 -- 172.21.15.73:0/2843433688 learned_addr learned my addr 172.21.15.73:0/2843433688 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8d200036c0 con 0x7f8d301452e0 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8d20003a50 con 0x7f8d301452e0 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f8d20003bb0 con 0x7f8d301452e0 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52707a2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526806d030 con 0x7f5268144a90 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52707a2700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526806d310 con 0x7f52680a8f20 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52707a2700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526806d5f0 con 0x7f52680ae410 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f526dd3d700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f52680ae410 0x7f526813f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51748/0 (socket says 172.21.15.73:51748) 2024-09-16T14:37:19.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f526dd3d700 1 -- 172.21.15.73:0/298158029 learned_addr learned my addr 172.21.15.73:0/298158029 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070214305 0 0) 0x7f9f9c0ab9d0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f880035d0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f8d2007f610 con 0x7f8d301452e0 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c2736700 1 -- start start 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c2736700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc06edd0 con 0x7f13bc0ae410 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c2736700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc1de930 con 0x7f13bc06de50 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c2736700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc06f040 con 0x7f13bc13c1e0 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c1734700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f13bc0ae410 0x7f13bc06f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47042/0 (socket says 172.21.15.73:47042) 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13c1734700 1 -- 172.21.15.73:0/1428440648 learned_addr learned my addr 172.21.15.73:0/1428440648 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213694557 0 0) 0x7f9f880035d0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524760519 0 0) 0x7f526806d5f0 con 0x7f52680ae410 2024-09-16T14:37:19.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6808/342316973 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d1c071f60 con 0x7f8d1c06e2b0 2024-09-16T14:37:19.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f524c0035d0 con 0x7f52680ae410 2024-09-16T14:37:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (unknown 4138596325 0 0) 0x7f8d2007f980 con 0x7f8d301452e0 2024-09-16T14:37:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 >> v1:172.21.15.73:6790/0 conn(0x7f9f9c0ae410 legacy=0x7f9f9c13a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415710843 0 0) 0x7f526806d310 con 0x7f52680a8f20 2024-09-16T14:37:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f526806d5f0 con 0x7f52680a8f20 2024-09-16T14:37:19.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3109189099 0 0) 0x7f524c0035d0 con 0x7f52680ae410 2024-09-16T14:37:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f526806d310 con 0x7f52680ae410 2024-09-16T14:37:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5260001fd0 con 0x7f52680ae410 2024-09-16T14:37:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821649182 0 0) 0x7f3b1c145c60 con 0x7f3b1c142b90 2024-09-16T14:37:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440835483 0 0) 0x7f52b0141560 con 0x7f52b00ae410 2024-09-16T14:37:19.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52940035d0 con 0x7f52b00ae410 2024-09-16T14:37:19.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347432167 0 0) 0x7f52b0137ae0 con 0x7f52b00a8f20 2024-09-16T14:37:19.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b0141560 con 0x7f52b00a8f20 2024-09-16T14:37:19.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04003810 con 0x7f3b1c142b90 2024-09-16T14:37:19.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 >> v1:172.21.15.177:6789/0 conn(0x7f9f9c0afd80 legacy=0x7f9f9c0ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336417161 0 0) 0x7f3b1c0b2110 con 0x7f3b1c1487e0 2024-09-16T14:37:19.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c145c60 con 0x7f3b1c1487e0 2024-09-16T14:37:19.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0aa170 con 0x7f9f9c0726f0 2024-09-16T14:37:19.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9f8c001610 con 0x7f9f9c0726f0 2024-09-16T14:37:19.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640216547 0 0) 0x7f3b1c143b30 con 0x7f3b1c0ae410 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c0b2110 con 0x7f3b1c0ae410 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453279888 0 0) 0x7f13bc1de930 con 0x7f13bc06de50 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a00035d0 con 0x7f13bc06de50 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412123779 0 0) 0x7f13bc06f040 con 0x7f13bc13c1e0 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13bc1de930 con 0x7f13bc13c1e0 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881072673 0 0) 0x7f13bc06edd0 con 0x7f13bc0ae410 2024-09-16T14:37:19.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13bc06f040 con 0x7f13bc0ae410 2024-09-16T14:37:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2788363468 0 0) 0x7f52b0141560 con 0x7f52b00a8f20 2024-09-16T14:37:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52b0137ae0 con 0x7f52b00a8f20 2024-09-16T14:37:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f52a8001bb0 con 0x7f52b00a8f20 2024-09-16T14:37:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd224001c20 con 0x7fd22c144a90 2024-09-16T14:37:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2314a9700 1 -- 172.21.15.73:0/3625896132 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd224001f30 con 0x7fd22c144a90 2024-09-16T14:37:19.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7fd2334ad700 1 -- 172.21.15.73:0/3625896132 >> v1:172.21.15.73:6790/0 conn(0x7fd22c144a90 legacy=0x7fd22c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3577671893 0 0) 0x7f3b1c145c60 con 0x7f3b1c1487e0 2024-09-16T14:37:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b1c143b30 con 0x7f3b1c1487e0 2024-09-16T14:37:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3b14001a60 con 0x7f3b1c1487e0 2024-09-16T14:37:19.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== osd.1 v1:172.21.15.73:6808/342316973 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f8d1c071f60 con 0x7f8d1c06e2b0 2024-09-16T14:37:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2154085888 0 0) 0x7f13bc1de930 con 0x7f13bc13c1e0 2024-09-16T14:37:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f13bc06edd0 con 0x7f13bc13c1e0 2024-09-16T14:37:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f13ac001790 con 0x7f13bc13c1e0 2024-09-16T14:37:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1447288242 0 0) 0x7f13a00035d0 con 0x7f13bc06de50 2024-09-16T14:37:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.494+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f13bc1de930 con 0x7f13bc06de50 2024-09-16T14:37:19.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f13b8001510 con 0x7f13bc06de50 2024-09-16T14:37:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1529359185 0 0) 0x7f52940035d0 con 0x7f52b00ae410 2024-09-16T14:37:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52b0141560 con 0x7f52b00ae410 2024-09-16T14:37:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266432103 0 0) 0x7f52b013b190 con 0x7f52b0144a90 2024-09-16T14:37:19.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3488173855 0 0) 0x7f3b04003810 con 0x7f3b1c142b90 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52940035d0 con 0x7f52b0144a90 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9f8c001900 con 0x7f9f9c0726f0 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9f93fff700 1 -- 172.21.15.73:0/2887851682 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9f8c001d10 con 0x7f9f9c0726f0 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 -- 172.21.15.73:0/2887851682 >> v1:172.21.15.73:6789/0 conn(0x7f9f9c0726f0 legacy=0x7f9f9c0ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 -- 172.21.15.73:0/2887851682 shutdown_connections 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 -- 172.21.15.73:0/2887851682 >> 172.21.15.73:0/2887851682 conn(0x7f9f9c0af290 msgr2=0x7f9f9c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 -- 172.21.15.73:0/2887851682 shutdown_connections 2024-09-16T14:37:19.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 -- 172.21.15.73:0/2887851682 wait complete. 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f52ac001760 con 0x7f52b00ae410 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2232115400 0 0) 0x7f52b0137ae0 con 0x7f52b00a8f20 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 >> v1:172.21.15.73:6790/0 conn(0x7f52b0144a90 legacy=0x7f52b01373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 >> v1:172.21.15.73:6789/0 conn(0x7f52b00ae410 legacy=0x7f52b0136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0141040 con 0x7f52b00a8f20 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b01403a0 con 0x7f52b00a8f20 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b0140b20 con 0x7f52b00a8f20 2024-09-16T14:37:19.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f52a80020a0 con 0x7f52b00a8f20 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13c0f33700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 legacy=0x7f13bc1ddb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13c0f33700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 legacy=0x7f13bc1ddb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13c0f33700 1 --1- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 0x7f13bc1ddb10 :-1 s=OPENED pgs=98 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13c0f33700 1 --1- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 0x7f13bc1ddb10 :-1 s=OPENED pgs=98 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2945650919 0 0) 0x7f13bc06f040 con 0x7f13bc0ae410 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f13a00035d0 con 0x7f13bc0ae410 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f13b4001c00 con 0x7f13bc0ae410 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1097036931 0 0) 0x7f13bc1de930 con 0x7f13bc06de50 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6790/0 conn(0x7f13bc13c1e0 legacy=0x7f13bc1ddb10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6789/0 conn(0x7f13bc0ae410 legacy=0x7f13bc06f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc06f320 con 0x7f13bc06de50 2024-09-16T14:37:19.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc0ab280 con 0x7f13bc06de50 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc0ac0a0 con 0x7f13bc06de50 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7fd2334ad700 1 -- 172.21.15.73:0/3625896132 shutdown_connections 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7fd2334ad700 1 -- 172.21.15.73:0/3625896132 >> 172.21.15.73:0/3625896132 conn(0x7fd22c0af290 msgr2=0x7fd22c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b1c145c60 con 0x7f3b1c142b90 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1929822164 0 0) 0x7f3b1c143b30 con 0x7f3b1c1487e0 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 >> v1:172.21.15.177:6789/0 conn(0x7f3b1c0ae410 legacy=0x7f3b1c1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 >> v1:172.21.15.73:6789/0 conn(0x7f3b1c142b90 legacy=0x7f3b1c13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c144d00 con 0x7f3b1c1487e0 2024-09-16T14:37:19.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c144fb0 con 0x7f3b1c1487e0 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c13eb00 con 0x7f3b1c1487e0 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f13b8004b40 con 0x7f13bc06de50 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1471290180 0 0) 0x7f526806d310 con 0x7f52680ae410 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 >> v1:172.21.15.177:6789/0 conn(0x7f52680a8f20 legacy=0x7f526813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 >> v1:172.21.15.73:6789/0 conn(0x7f5268144a90 legacy=0x7f52681e4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52681407d0 con 0x7f52680ae410 2024-09-16T14:37:19.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5268143440 con 0x7f52680ae410 2024-09-16T14:37:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f52681e61f0 con 0x7f52680ae410 2024-09-16T14:37:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f13b8004e50 con 0x7f13bc06de50 2024-09-16T14:37:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 Processor -- start 2024-09-16T14:37:19.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f52a8004db0 con 0x7f52b00a8f20 2024-09-16T14:37:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f9fa2723700 1 -- start start 2024-09-16T14:37:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3b14001fb0 con 0x7f3b1c1487e0 2024-09-16T14:37:19.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f13b8019ff0 con 0x7f13bc06de50 2024-09-16T14:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7fd2334ad700 1 -- 172.21.15.73:0/3625896132 shutdown_connections 2024-09-16T14:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3b14003a40 con 0x7f3b1c1487e0 2024-09-16T14:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f3b14018be0 con 0x7f3b1c1487e0 2024-09-16T14:37:19.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.177:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5290000f10 con 0x7f52b00a8f20 2024-09-16T14:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5260004ec0 con 0x7f52680ae410 2024-09-16T14:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f5260005250 con 0x7f52680ae410 2024-09-16T14:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.498+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.73:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5250000f10 con 0x7f52680ae410 2024-09-16T14:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f5260005470 con 0x7f52680ae410 2024-09-16T14:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.73:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b00000f10 con 0x7f3b1c1487e0 2024-09-16T14:37:19.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.177:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f139c000f10 con 0x7f13bc06de50 2024-09-16T14:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd2334ad700 1 -- 172.21.15.73:0/3625896132 wait complete. 2024-09-16T14:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa2723700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c143500 con 0x7f9f9c0afd80 2024-09-16T14:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa2723700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c071ad0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa2723700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c1455a0 con 0x7f9f9c0ae410 2024-09-16T14:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa1f22700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9f9c0afd80 0x7f9f9c1de510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47090/0 (socket says 172.21.15.73:47090) 2024-09-16T14:37:19.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa1f22700 1 -- 172.21.15.73:0/204970249 learned_addr learned my addr 172.21.15.73:0/204970249 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f526007fa90 con 0x7f52680ae410 2024-09-16T14:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790166132 0 0) 0x7f9f9c071ad0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.177:6801/573978299 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f524c071c70 con 0x7f524c06dfc0 2024-09-16T14:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f800035d0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324690264 0 0) 0x7f9f9c143500 con 0x7f9f9c0afd80 2024-09-16T14:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f9c071ad0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f3b1407e300 con 0x7f3b1c1487e0 2024-09-16T14:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.177:6808/3844040909 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b04072420 con 0x7f3b0406e810 2024-09-16T14:37:19.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (unknown 4138596325 0 0) 0x7f3b1404bb00 con 0x7f3b1c1487e0 2024-09-16T14:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f52a8019f50 con 0x7f52b00a8f20 2024-09-16T14:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f52a807f7b0 con 0x7f52b00a8f20 2024-09-16T14:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.73:6800/303375583 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5294072100 con 0x7f529406e4f0 2024-09-16T14:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f13b807f530 con 0x7f13bc06de50 2024-09-16T14:37:19.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414985919 0 0) 0x7f9f9c1455a0 con 0x7f9f9c0ae410 2024-09-16T14:37:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f9c143500 con 0x7f9f9c0ae410 2024-09-16T14:37:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (unknown 4138596325 0 0) 0x7f526004d370 con 0x7f52680ae410 2024-09-16T14:37:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 704888535 0 0) 0x7f9f9c071ad0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f9c1455a0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3425999996 0 0) 0x7f9f800035d0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.73:6812/1569396656 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13a00720e0 con 0x7f13a006e4d0 2024-09-16T14:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (unknown 4138596325 0 0) 0x7f13b807f8c0 con 0x7f13bc06de50 2024-09-16T14:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f9c071ad0 con 0x7f9f9c0726f0 2024-09-16T14:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9f94001a50 con 0x7f9f9c0afd80 2024-09-16T14:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9f98001780 con 0x7f9f9c0726f0 2024-09-16T14:37:19.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (unknown 4138596325 0 0) 0x7f52a804cf30 con 0x7f52b00a8f20 2024-09-16T14:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd2334ad700 1 Processor -- start 2024-09-16T14:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 394147578 0 0) 0x7f9f9c1455a0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 >> v1:172.21.15.73:6790/0 conn(0x7f9f9c0ae410 legacy=0x7f9f9c144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 >> v1:172.21.15.177:6789/0 conn(0x7f9f9c0726f0 legacy=0x7f9f9c143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c145880 con 0x7f9f9c0afd80 2024-09-16T14:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c145b60 con 0x7f9f9c0afd80 2024-09-16T14:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c140ac0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f64b7ea0700 1 Processor -- start 2024-09-16T14:37:19.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f64b7ea0700 1 -- start start 2024-09-16T14:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== osd.2 v1:172.21.15.73:6800/303375583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f5294072100 con 0x7f529406e4f0 2024-09-16T14:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd2334ad700 1 -- start start 2024-09-16T14:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd2334ad700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c137b70 con 0x7fd22c0ae410 2024-09-16T14:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd2334ad700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c141bf0 con 0x7fd22c0a8f20 2024-09-16T14:37:19.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd2334ad700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c140f40 con 0x7fd22c144a90 2024-09-16T14:37:19.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== osd.3 v1:172.21.15.73:6812/1569396656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f13a00720e0 con 0x7f13a006e4d0 2024-09-16T14:37:19.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== osd.4 v1:172.21.15.177:6801/573978299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f524c071c70 con 0x7f524c06dfc0 2024-09-16T14:37:19.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.506+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== osd.7 v1:172.21.15.177:6808/3844040909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f3b04072420 con 0x7f3b0406e810 2024-09-16T14:37:19.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.506+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9f94002080 con 0x7f9f9c0afd80 2024-09-16T14:37:19.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.506+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9f94003be0 con 0x7f9f9c0afd80 2024-09-16T14:37:19.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.506+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f9f94003d80 con 0x7f9f9c0afd80 2024-09-16T14:37:19.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.506+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f9f9407f640 con 0x7f9f9c0afd80 2024-09-16T14:37:19.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6804/3200602632 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f7c005330 con 0x7f9f7c0015c0 2024-09-16T14:37:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7f64b7ea0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b013ed80 con 0x7f64b013e970 2024-09-16T14:37:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7f64b7ea0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b00b1450 con 0x7f64b00b0890 2024-09-16T14:37:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7f64b7ea0700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b00a85f0 con 0x7f64b00b3e00 2024-09-16T14:37:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7f64b5c3c700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f64b00b3e00 0x7f64b00a8b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51778/0 (socket says 172.21.15.73:51778) 2024-09-16T14:37:19.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7f64b5c3c700 1 -- 172.21.15.73:0/3772087064 learned_addr learned my addr 172.21.15.73:0/3772087064 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd231caa700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd22c0ae410 0x7fd22c136d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47092/0 (socket says 172.21.15.73:47092) 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.502+0000 7fd231caa700 1 -- 172.21.15.73:0/2138685876 learned_addr learned my addr 172.21.15.73:0/2138685876 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428045588 0 0) 0x7fd22c137b70 con 0x7fd22c0ae410 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2100035d0 con 0x7fd22c0ae410 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272035174 0 0) 0x7fd22c141bf0 con 0x7fd22c0a8f20 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c137b70 con 0x7fd22c0a8f20 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834632068 0 0) 0x7fd22c140f40 con 0x7fd22c144a90 2024-09-16T14:37:19.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c141bf0 con 0x7fd22c144a90 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3761211608 0 0) 0x7fd2100035d0 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd22c140f40 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd21c001920 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3955621458 0 0) 0x7fd22c140f40 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 >> v1:172.21.15.73:6790/0 conn(0x7fd22c144a90 legacy=0x7fd22c137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 >> v1:172.21.15.177:6789/0 conn(0x7fd22c0a8f20 legacy=0x7fd22c1414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c06d030 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c06d220 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c140b70 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd21c0036a0 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd21c003a30 con 0x7fd22c0ae410 2024-09-16T14:37:19.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.510+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fd21c003b90 con 0x7fd22c0ae410 2024-09-16T14:37:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267175390 0 0) 0x7f64b00a85f0 con 0x7f64b00b3e00 2024-09-16T14:37:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f649c0035d0 con 0x7f64b00b3e00 2024-09-16T14:37:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248390706 0 0) 0x7f64b00b1450 con 0x7f64b00b0890 2024-09-16T14:37:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b00a85f0 con 0x7f64b00b0890 2024-09-16T14:37:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023601695 0 0) 0x7f64b00a85f0 con 0x7f64b00b0890 2024-09-16T14:37:19.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 >> v1:172.21.15.73:6790/0 conn(0x7f64b00b3e00 legacy=0x7f64b00a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fd21c07f5b0 con 0x7fd22c0ae410 2024-09-16T14:37:19.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 >> v1:172.21.15.73:6789/0 conn(0x7f64b013e970 legacy=0x7f64b014c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T14:37:19.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00a9220 con 0x7f64b00b0890 2024-09-16T14:37:19.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f64ac0014c0 con 0x7f64b00b0890 2024-09-16T14:37:19.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f64ac001620 con 0x7f64b00b0890 2024-09-16T14:37:19.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b4c3a700 1 -- 172.21.15.73:0/3772087064 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f64ac0019f0 con 0x7f64b00b0890 2024-09-16T14:37:19.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== osd.0 v1:172.21.15.73:6804/3200602632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f9f7c005330 con 0x7f9f7c0015c0 2024-09-16T14:37:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.514+0000 7f64b7ea0700 1 -- 172.21.15.73:0/3772087064 >> v1:172.21.15.177:6789/0 conn(0x7f64b00b0890 legacy=0x7f64b013e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.518+0000 7f64b7ea0700 1 -- 172.21.15.73:0/3772087064 shutdown_connections 2024-09-16T14:37:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.518+0000 7f64b7ea0700 1 -- 172.21.15.73:0/3772087064 >> 172.21.15.73:0/3772087064 conn(0x7f64b0073b10 msgr2=0x7f64b0073ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 -- 172.21.15.73:0/3772087064 shutdown_connections 2024-09-16T14:37:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 -- 172.21.15.73:0/3772087064 wait complete. 2024-09-16T14:37:19.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.177:6809/702447135 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd214005330 con 0x7fd2140015c0 2024-09-16T14:37:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 --> v1:172.21.15.177:6808/3844040909 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b00002bc0 con 0x7f3b0406e810 2024-09-16T14:37:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f3b0affd700 1 -- 172.21.15.73:0/3488608456 <== osd.7 v1:172.21.15.177:6808/3844040909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 982563978) 0x7f3b00002bc0 con 0x7f3b0406e810 2024-09-16T14:37:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 Processor -- start 2024-09-16T14:37:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 -- start start 2024-09-16T14:37:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b0137920 con 0x7f64b013e970 2024-09-16T14:37:19.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b0137f60 con 0x7f64b00b3e00 2024-09-16T14:37:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b7ea0700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b01382d0 con 0x7f64b00b0890 2024-09-16T14:37:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b5c3c700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f64b00b0890 0x7f64b0141210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51788/0 (socket says 172.21.15.73:51788) 2024-09-16T14:37:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64b5c3c700 1 -- 172.21.15.73:0/2784415162 learned_addr learned my addr 172.21.15.73:0/2784415162 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== osd.5 v1:172.21.15.177:6809/702447135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7fd214005330 con 0x7fd2140015c0 2024-09-16T14:37:19.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 >> v1:172.21.15.177:6808/3844040909 conn(0x7f3b0406e810 legacy=0x7f3b04070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206997087 0 0) 0x7f64b01382d0 con 0x7f64b00b0890 2024-09-16T14:37:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64940035d0 con 0x7f64b00b0890 2024-09-16T14:37:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204892119 0 0) 0x7f64b0137f60 con 0x7f64b00b3e00 2024-09-16T14:37:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b01382d0 con 0x7f64b00b3e00 2024-09-16T14:37:19.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935274876 0 0) 0x7f64b0137920 con 0x7f64b013e970 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b0137f60 con 0x7f64b013e970 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 698951005 0 0) 0x7f64940035d0 con 0x7f64b00b0890 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64b0137920 con 0x7f64b00b0890 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f64a8001db0 con 0x7f64b00b0890 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 372509151 0 0) 0x7f64b0137f60 con 0x7f64b013e970 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64940035d0 con 0x7f64b013e970 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f64a00015a0 con 0x7f64b013e970 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3410190993 0 0) 0x7f64b01382d0 con 0x7f64b00b3e00 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64b0137f60 con 0x7f64b00b3e00 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f64ac001790 con 0x7f64b00b3e00 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2706944324 0 0) 0x7f64b0137920 con 0x7f64b00b0890 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 >> v1:172.21.15.177:6789/0 conn(0x7f64b00b3e00 legacy=0x7f64b0136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.522+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 >> v1:172.21.15.73:6789/0 conn(0x7f64b013e970 legacy=0x7f64b0137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b013ae00 con 0x7f64b00b0890 2024-09-16T14:37:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 >> v1:172.21.15.177:6816/2823028339 conn(0x7f3b04067950 legacy=0x7f3b04069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b0141920 con 0x7f64b00b0890 2024-09-16T14:37:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b0141f40 con 0x7f64b00b0890 2024-09-16T14:37:19.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f64a8002070 con 0x7f64b00b0890 2024-09-16T14:37:19.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 >> v1:172.21.15.73:6790/0 conn(0x7f3b1c1487e0 legacy=0x7f3b1c1e2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1ad9d700 1 -- 172.21.15.73:0/3488608456 reap_dead start 2024-09-16T14:37:19.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 shutdown_connections 2024-09-16T14:37:19.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 >> 172.21.15.73:0/3488608456 conn(0x7f3b1c0af290 msgr2=0x7f3b1c0a9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f64a8005060 con 0x7f64b00b0890 2024-09-16T14:37:19.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f64a801a200 con 0x7f64b00b0890 2024-09-16T14:37:19.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f64a807fa50 con 0x7f64b00b0890 2024-09-16T14:37:19.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.177:6800/877193733 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6498005330 con 0x7f64980015c0 2024-09-16T14:37:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 --> v1:172.21.15.73:6812/1569396656 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f139c002bd0 con 0x7f13a006e4d0 2024-09-16T14:37:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 --> v1:172.21.15.73:6808/342316973 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d30067870 con 0x7f8d1c06e2b0 2024-09-16T14:37:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 shutdown_connections 2024-09-16T14:37:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.526+0000 7f3b1b59e700 1 -- 172.21.15.73:0/3488608456 wait complete. 2024-09-16T14:37:19.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f13b1ffb700 1 -- 172.21.15.73:0/1428440648 <== osd.3 v1:172.21.15.73:6812/1569396656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 982563978) 0x7f139c002bd0 con 0x7f13a006e4d0 2024-09-16T14:37:19.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 --> v1:172.21.15.177:6801/573978299 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5250002bd0 con 0x7f524c06dfc0 2024-09-16T14:37:19.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d2cff9700 1 -- 172.21.15.73:0/1585198650 <== osd.1 v1:172.21.15.73:6808/342316973 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2451364910) 0x7f8d30067870 con 0x7f8d1c06e2b0 2024-09-16T14:37:19.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f525effd700 1 -- 172.21.15.73:0/298158029 <== osd.4 v1:172.21.15.177:6801/573978299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 982563978) 0x7f5250002bd0 con 0x7f524c06dfc0 2024-09-16T14:37:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 >> v1:172.21.15.73:6808/342316973 conn(0x7f8d1c06e2b0 legacy=0x7f8d1c0706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 >> v1:172.21.15.177:6816/2823028339 conn(0x7f8d1c067280 legacy=0x7f8d1c069740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 >> v1:172.21.15.73:6790/0 conn(0x7f8d301452e0 legacy=0x7f8d3013e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3492c700 1 -- 172.21.15.73:0/1585198650 reap_dead start 2024-09-16T14:37:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 shutdown_connections 2024-09-16T14:37:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 >> 172.21.15.73:0/1585198650 conn(0x7f8d300af290 msgr2=0x7f8d3013f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 >> v1:172.21.15.177:6801/573978299 conn(0x7f524c06dfc0 legacy=0x7f524c070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 shutdown_connections 2024-09-16T14:37:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 >> v1:172.21.15.177:6816/2823028339 conn(0x7f524c066f90 legacy=0x7f524c069450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 >> v1:172.21.15.73:6790/0 conn(0x7f52680ae410 legacy=0x7f526813f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f526ed3f700 1 -- 172.21.15.73:0/298158029 reap_dead start 2024-09-16T14:37:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f8d3512d700 1 -- 172.21.15.73:0/1585198650 wait complete. 2024-09-16T14:37:19.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== osd.6 v1:172.21.15.177:6800/877193733 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f6498005330 con 0x7f64980015c0 2024-09-16T14:37:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 shutdown_connections 2024-09-16T14:37:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 >> 172.21.15.73:0/298158029 conn(0x7f52680af290 msgr2=0x7f526813e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 --> v1:172.21.15.73:6800/303375583 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5290002bd0 con 0x7f529406e4f0 2024-09-16T14:37:19.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52a5ffb700 1 -- 172.21.15.73:0/2843433688 <== osd.2 v1:172.21.15.73:6800/303375583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1618435885) 0x7f5290002bd0 con 0x7f529406e4f0 2024-09-16T14:37:19.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 >> v1:172.21.15.73:6800/303375583 conn(0x7f529406e4f0 legacy=0x7f5294070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 >> v1:172.21.15.177:6816/2823028339 conn(0x7f5294067630 legacy=0x7f5294069af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 >> v1:172.21.15.177:6789/0 conn(0x7f52b00a8f20 legacy=0x7f52b01d9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b5bb2700 1 -- 172.21.15.73:0/2843433688 reap_dead start 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 shutdown_connections 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 >> 172.21.15.73:0/2843433688 conn(0x7f52b00af290 msgr2=0x7f52b00b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 shutdown_connections 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f52b63b3700 1 -- 172.21.15.73:0/2843433688 wait complete. 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.73:6812/1569396656 conn(0x7f13a006e4d0 legacy=0x7f13a0070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.177:6816/2823028339 conn(0x7f13a0067610 legacy=0x7f13a0069ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.530+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 >> v1:172.21.15.177:6789/0 conn(0x7f13bc06de50 legacy=0x7f13bc1de220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f13c1f35700 1 -- 172.21.15.73:0/1428440648 reap_dead start 2024-09-16T14:37:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 shutdown_connections 2024-09-16T14:37:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 >> 172.21.15.73:0/1428440648 conn(0x7f13bc0af290 msgr2=0x7f13bc0a8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 shutdown_connections 2024-09-16T14:37:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.534+0000 7f13c2736700 1 -- 172.21.15.73:0/1428440648 wait complete. 2024-09-16T14:37:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.538+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 shutdown_connections 2024-09-16T14:37:19.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.538+0000 7f52707a2700 1 -- 172.21.15.73:0/298158029 wait complete. 2024-09-16T14:37:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.538+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 --> v1:172.21.15.73:6804/3200602632 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f7c006fa0 con 0x7f9f7c0015c0 2024-09-16T14:37:19.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.542+0000 7f9f91ffb700 1 -- 172.21.15.73:0/204970249 <== osd.0 v1:172.21.15.73:6804/3200602632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2451364910) 0x7f9f7c006fa0 con 0x7f9f7c0015c0 2024-09-16T14:37:19.585 INFO:teuthology.orchestra.run.smithi073.stdout:60129542148 2024-09-16T14:37:19.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.542+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 >> v1:172.21.15.73:6804/3200602632 conn(0x7f9f7c0015c0 legacy=0x7f9f7c003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.542+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 >> v1:172.21.15.177:6816/2823028339 conn(0x7f9f800675e0 legacy=0x7f9f80069aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.542+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 >> v1:172.21.15.73:6789/0 conn(0x7f9f9c0afd80 legacy=0x7f9f9c1de510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.546+0000 7f9fa1f22700 1 -- 172.21.15.73:0/204970249 reap_dead start 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.546+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 shutdown_connections 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.546+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 >> 172.21.15.73:0/204970249 conn(0x7f9f9c0af290 msgr2=0x7f9f9c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.546+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 shutdown_connections 2024-09-16T14:37:19.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.546+0000 7f9fa2723700 1 -- 172.21.15.73:0/204970249 wait complete. 2024-09-16T14:37:19.587 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:19.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T14:37:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 --> v1:172.21.15.177:6809/702447135 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd214006fd0 con 0x7fd2140015c0 2024-09-16T14:37:19.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd222ffd700 1 -- 172.21.15.73:0/2138685876 <== osd.5 v1:172.21.15.177:6809/702447135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 982563978) 0x7fd214006fd0 con 0x7fd2140015c0 2024-09-16T14:37:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 >> v1:172.21.15.177:6809/702447135 conn(0x7fd2140015c0 legacy=0x7fd214003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 >> v1:172.21.15.177:6816/2823028339 conn(0x7fd210077eb0 legacy=0x7fd21007a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 >> v1:172.21.15.73:6789/0 conn(0x7fd22c0ae410 legacy=0x7fd22c136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd232cac700 1 -- 172.21.15.73:0/2138685876 reap_dead start 2024-09-16T14:37:19.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 shutdown_connections 2024-09-16T14:37:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 >> 172.21.15.73:0/2138685876 conn(0x7fd22c0af290 msgr2=0x7fd22c13e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 shutdown_connections 2024-09-16T14:37:19.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.550+0000 7fd2334ad700 1 -- 172.21.15.73:0/2138685876 wait complete. 2024-09-16T14:37:19.590 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:19.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T14:37:19.591 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:19.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T14:37:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.554+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 --> v1:172.21.15.177:6800/877193733 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6498006fd0 con 0x7f64980015c0 2024-09-16T14:37:19.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.554+0000 7f64a67fc700 1 -- 172.21.15.73:0/2784415162 <== osd.6 v1:172.21.15.177:6800/877193733 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2451364910) 0x7f6498006fd0 con 0x7f64980015c0 2024-09-16T14:37:19.593 INFO:teuthology.orchestra.run.smithi073.stdout:60129542149 2024-09-16T14:37:19.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T14:37:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.554+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 >> v1:172.21.15.177:6800/877193733 conn(0x7f64980015c0 legacy=0x7f6498003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 >> v1:172.21.15.177:6816/2823028339 conn(0x7f6494067870 legacy=0x7f6494069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 >> v1:172.21.15.73:6790/0 conn(0x7f64b00b0890 legacy=0x7f64b0141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b643d700 1 -- 172.21.15.73:0/2784415162 reap_dead start 2024-09-16T14:37:19.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 shutdown_connections 2024-09-16T14:37:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 >> 172.21.15.73:0/2784415162 conn(0x7f64b0073b10 msgr2=0x7f64b013c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 shutdown_connections 2024-09-16T14:37:19.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.558+0000 7f64b7ea0700 1 -- 172.21.15.73:0/2784415162 wait complete. 2024-09-16T14:37:19.597 INFO:teuthology.orchestra.run.smithi073.stdout:60129542148 2024-09-16T14:37:19.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T14:37:19.598 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:19.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T14:37:19.599 INFO:teuthology.orchestra.run.smithi073.stdout:60129542148 2024-09-16T14:37:19.599 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T14:37:19.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9dcf96700 1 Processor -- start 2024-09-16T14:37:19.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9dcf96700 1 -- start start 2024-09-16T14:37:19.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcd5220700 1 Processor -- start 2024-09-16T14:37:19.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcd5220700 1 -- start start 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9dcf96700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80aa1b0 con 0x7fb9d80a8f20 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9dcf96700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80a8a00 con 0x7fb9d8144a90 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9dcf96700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80aecf0 con 0x7fb9d80ae410 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d77fe700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb9d80ae410 0x7fb9d8144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51802/0 (socket says 172.21.15.73:51802) 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d77fe700 1 -- 172.21.15.73:0/1449272263 learned_addr learned my addr 172.21.15.73:0/1449272263 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d6ffd700 1 --1- 172.21.15.73:0/1449272263 >> v1:172.21.15.73:6789/0 conn(0x7fb9d80a8f20 0x7fb9d813e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47126/0 (socket says 172.21.15.73:47126) 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372638076 0 0) 0x7fb9d80aecf0 con 0x7fb9d80ae410 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c00035d0 con 0x7fb9d80ae410 2024-09-16T14:37:19.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801803829 0 0) 0x7fb9d80aa1b0 con 0x7fb9d80a8f20 2024-09-16T14:37:19.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d80aecf0 con 0x7fb9d80a8f20 2024-09-16T14:37:19.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122688722 0 0) 0x7fb9c00035d0 con 0x7fb9d80ae410 2024-09-16T14:37:19.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 >> v1:172.21.15.177:6789/0 conn(0x7fb9d8144a90 legacy=0x7fb9d814c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T14:37:19.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 >> v1:172.21.15.73:6789/0 conn(0x7fb9d80a8f20 legacy=0x7fb9d813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbccf7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbcd01487e0 0x7fbcd0142480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47134/0 (socket says 172.21.15.73:47134) 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbccf7fe700 1 -- 172.21.15.73:0/3578751980 learned_addr learned my addr 172.21.15.73:0/3578751980 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd00abc50 con 0x7fbcd01487e0 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd00abf30 con 0x7fbcd00ae410 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251476679 0 0) 0x7fbcd00abc50 con 0x7fbcd01487e0 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd00acad0 con 0x7fbcd0142b90 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80aee80 con 0x7fb9d80ae410 2024-09-16T14:37:19.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb9cc001610 con 0x7fb9d80ae410 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb9cc0018f0 con 0x7fb9d80ae410 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9d67fc700 1 -- 172.21.15.73:0/1449272263 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb9cc001c80 con 0x7fb9d80ae410 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fb9dcf96700 1 -- 172.21.15.73:0/1449272263 >> v1:172.21.15.73:6790/0 conn(0x7fb9d80ae410 legacy=0x7fb9d8144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb80035d0 con 0x7fbcd01487e0 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756434370 0 0) 0x7fbcd00acad0 con 0x7fbcd0142b90 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd00abc50 con 0x7fbcd0142b90 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452727251 0 0) 0x7fbcd00abf30 con 0x7fbcd00ae410 2024-09-16T14:37:19.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd00acad0 con 0x7fbcd00ae410 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4026554758 0 0) 0x7fbcb80035d0 con 0x7fbcd01487e0 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 >> v1:172.21.15.73:6790/0 conn(0x7fbcd0142b90 legacy=0x7fbcd0150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 >> v1:172.21.15.177:6789/0 conn(0x7fbcd00ae410 legacy=0x7fbcd00ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00aaf20 con 0x7fbcd01487e0 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbcc8001990 con 0x7fbcd01487e0 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbcc8001c70 con 0x7fbcd01487e0 2024-09-16T14:37:19.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcceffd700 1 -- 172.21.15.73:0/3578751980 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbcc8002000 con 0x7fbcd01487e0 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67d10aa700 1 Processor -- start 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67d10aa700 1 -- start start 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67d10aa700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc0a9700 con 0x7f67cc0ae410 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67d10aa700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc0ab000 con 0x7f67cc072760 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67d10aa700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc0ab270 con 0x7f67cc0a8b60 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67cbfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f67cc0ae410 0x7f67cc0ac310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47148/0 (socket says 172.21.15.73:47148) 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67cbfff700 1 -- 172.21.15.73:0/1074289853 learned_addr learned my addr 172.21.15.73:0/1074289853 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.774+0000 7f67d08a9700 1 --1- 172.21.15.73:0/1074289853 >> v1:172.21.15.73:6790/0 conn(0x7f67cc0a8b60 0x7f67cc0a8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51826/0 (socket says 172.21.15.73:51826) 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411540383 0 0) 0x7f67cc0a9700 con 0x7f67cc0ae410 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b40035d0 con 0x7f67cc0ae410 2024-09-16T14:37:19.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72865351 0 0) 0x7f67cc0ab270 con 0x7f67cc0a8b60 2024-09-16T14:37:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67cc0a9700 con 0x7f67cc0a8b60 2024-09-16T14:37:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580260783 0 0) 0x7f67cc0ab000 con 0x7f67cc072760 2024-09-16T14:37:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67cc0ab270 con 0x7f67cc072760 2024-09-16T14:37:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- 172.21.15.73:0/1449272263 shutdown_connections 2024-09-16T14:37:19.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- 172.21.15.73:0/1449272263 >> 172.21.15.73:0/1449272263 conn(0x7fb9d80af290 msgr2=0x7fb9d80af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- 172.21.15.73:0/1449272263 shutdown_connections 2024-09-16T14:37:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 29884508 0 0) 0x7f67cc0a9700 con 0x7f67cc0a8b60 2024-09-16T14:37:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 >> v1:172.21.15.177:6789/0 conn(0x7f67cc072760 legacy=0x7f67cc0a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 >> v1:172.21.15.73:6789/0 conn(0x7f67cc0ae410 legacy=0x7f67cc0ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc0ab550 con 0x7f67cc0a8b60 2024-09-16T14:37:19.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f67c00014a0 con 0x7f67cc0a8b60 2024-09-16T14:37:19.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f67c00016c0 con 0x7f67cc0a8b60 2024-09-16T14:37:19.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67caffd700 1 -- 172.21.15.73:0/1074289853 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f67c0001ad0 con 0x7f67cc0a8b60 2024-09-16T14:37:19.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 >> v1:172.21.15.73:6789/0 conn(0x7fbcd01487e0 legacy=0x7fbcd0142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- 172.21.15.73:0/1449272263 wait complete. 2024-09-16T14:37:19.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 Processor -- start 2024-09-16T14:37:19.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- start start 2024-09-16T14:37:19.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5761dc700 1 Processor -- start 2024-09-16T14:37:19.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67d10aa700 1 -- 172.21.15.73:0/1074289853 >> v1:172.21.15.73:6790/0 conn(0x7f67cc0a8b60 legacy=0x7f67cc0a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5761dc700 1 -- start start 2024-09-16T14:37:19.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d81d6660 con 0x7fb9d80ae410 2024-09-16T14:37:19.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d811a9d0 con 0x7fb9d8144a90 2024-09-16T14:37:19.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9dcf96700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d811acb0 con 0x7fb9d80a8f20 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5761dc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700aa1b0 con 0x7fa570144a90 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5761dc700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700a8a00 con 0x7fa5700ae410 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5761dc700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700aecf0 con 0x7fa5700a8f20 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5749d9700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fa5700a8f20 0x7fa57013e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51840/0 (socket says 172.21.15.73:51840) 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa5749d9700 1 -- 172.21.15.73:0/3150003799 learned_addr learned my addr 172.21.15.73:0/3150003799 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9d6ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb9d80ae410 0x7fb9d81377c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47164/0 (socket says 172.21.15.73:47164) 2024-09-16T14:37:19.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fb9d6ffd700 1 -- 172.21.15.73:0/3551863706 learned_addr learned my addr 172.21.15.73:0/3551863706 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67d10aa700 1 -- 172.21.15.73:0/1074289853 shutdown_connections 2024-09-16T14:37:19.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67d10aa700 1 -- 172.21.15.73:0/1074289853 >> 172.21.15.73:0/1074289853 conn(0x7f67cc0af290 msgr2=0x7f67cc0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67d10aa700 1 -- 172.21.15.73:0/1074289853 shutdown_connections 2024-09-16T14:37:19.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7f67d10aa700 1 -- 172.21.15.73:0/1074289853 wait complete. 2024-09-16T14:37:19.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 shutdown_connections 2024-09-16T14:37:19.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 >> 172.21.15.73:0/3578751980 conn(0x7fbcd00af290 msgr2=0x7fbcd00af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730800136 0 0) 0x7fa5700aecf0 con 0x7fa5700a8f20 2024-09-16T14:37:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa55c0035d0 con 0x7fa5700a8f20 2024-09-16T14:37:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966250421 0 0) 0x7fa5700aa1b0 con 0x7fa570144a90 2024-09-16T14:37:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5700aecf0 con 0x7fa570144a90 2024-09-16T14:37:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126398831 0 0) 0x7fa5700a8a00 con 0x7fa5700ae410 2024-09-16T14:37:19.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.778+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5700aa1b0 con 0x7fa5700ae410 2024-09-16T14:37:19.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666076557 0 0) 0x7fb9d81d6660 con 0x7fb9d80ae410 2024-09-16T14:37:19.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9bc0035d0 con 0x7fb9d80ae410 2024-09-16T14:37:19.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 shutdown_connections 2024-09-16T14:37:19.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fbcd5220700 1 -- 172.21.15.73:0/3578751980 wait complete. 2024-09-16T14:37:19.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59871110 0 0) 0x7fb9d811a9d0 con 0x7fb9d8144a90 2024-09-16T14:37:19.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d81d6660 con 0x7fb9d8144a90 2024-09-16T14:37:19.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287100748 0 0) 0x7fb9d811acb0 con 0x7fb9d80a8f20 2024-09-16T14:37:19.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d811a9d0 con 0x7fb9d80a8f20 2024-09-16T14:37:19.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe592143700 1 Processor -- start 2024-09-16T14:37:19.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe592143700 1 -- start start 2024-09-16T14:37:19.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2525377237 0 0) 0x7fb9bc0035d0 con 0x7fb9d80ae410 2024-09-16T14:37:19.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb9d811acb0 con 0x7fb9d80ae410 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb9d0001cb0 con 0x7fb9d80ae410 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3045792689 0 0) 0x7fb9d81d6660 con 0x7fb9d8144a90 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb9bc0035d0 con 0x7fb9d8144a90 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb9c80015c0 con 0x7fb9d8144a90 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1612972516 0 0) 0x7fb9d811acb0 con 0x7fb9d80ae410 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 >> v1:172.21.15.73:6790/0 conn(0x7fb9d80a8f20 legacy=0x7fb9d81d5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 >> v1:172.21.15.177:6789/0 conn(0x7fb9d8144a90 legacy=0x7fb9d81e1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8140cc0 con 0x7fb9d80ae410 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d8143b10 con 0x7fb9d80ae410 2024-09-16T14:37:19.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d8140a10 con 0x7fb9d80ae410 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67d10aa700 1 Processor -- start 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67d10aa700 1 -- start start 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe592143700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c0aa1b0 con 0x7fe58c144a90 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe592143700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c0a8a00 con 0x7fe58c0ae410 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe592143700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c0aecf0 con 0x7fe58c0a8f20 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fbcd5220700 1 Processor -- start 2024-09-16T14:37:19.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fbcd5220700 1 -- start start 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d8067870 con 0x7fb9d80ae410 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb9d0004c10 con 0x7fb9d80ae410 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb9d0004f20 con 0x7fb9d80ae410 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67d10aa700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc152830 con 0x7f67cc0ae410 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67d10aa700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc06f4f0 con 0x7f67cc0a8b60 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67d10aa700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67cc1e6230 con 0x7f67cc070db0 2024-09-16T14:37:19.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67cb7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f67cc0ae410 0x7f67cc089410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47182/0 (socket says 172.21.15.73:47182) 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7f67cb7fe700 1 -- 172.21.15.73:0/2090119970 learned_addr learned my addr 172.21.15.73:0/2090119970 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58affd700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe58c0a8f20 0x7fe58c13e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51858/0 (socket says 172.21.15.73:51858) 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58affd700 1 -- 172.21.15.73:0/1872411110 learned_addr learned my addr 172.21.15.73:0/1872411110 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881275893 0 0) 0x7fe58c0aecf0 con 0x7fe58c0a8f20 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5740035d0 con 0x7fe58c0a8f20 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71862752 0 0) 0x7fe58c0a8a00 con 0x7fe58c0ae410 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe58c0aecf0 con 0x7fe58c0ae410 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924416301 0 0) 0x7fe58c0aa1b0 con 0x7fe58c144a90 2024-09-16T14:37:19.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe58c0a8a00 con 0x7fe58c144a90 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3997159131 0 0) 0x7fa5700aecf0 con 0x7fa570144a90 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 >> v1:172.21.15.73:6790/0 conn(0x7fa5700a8f20 legacy=0x7fa57013e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 >> v1:172.21.15.177:6789/0 conn(0x7fa5700ae410 legacy=0x7fa570144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700aee80 con 0x7fa570144a90 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa568001820 con 0x7fa570144a90 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa568001a40 con 0x7fa570144a90 2024-09-16T14:37:19.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa567fff700 1 -- 172.21.15.73:0/3150003799 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa568001e50 con 0x7fa570144a90 2024-09-16T14:37:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e345d700 1 Processor -- start 2024-09-16T14:37:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e345d700 1 -- start start 2024-09-16T14:37:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e345d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0ab9d0 con 0x7fc8dc13a840 2024-09-16T14:37:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e345d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0abcb0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e345d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0aa510 con 0x7fc8dc0726f0 2024-09-16T14:37:19.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1c5a700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc8dc0726f0 0x7fc8dc0ac0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51874/0 (socket says 172.21.15.73:51874) 2024-09-16T14:37:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1c5a700 1 -- 172.21.15.73:0/2496085332 learned_addr learned my addr 172.21.15.73:0/2496085332 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974240503 0 0) 0x7fe5740035d0 con 0x7fe58c0a8f20 2024-09-16T14:37:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 >> v1:172.21.15.177:6789/0 conn(0x7fe58c0ae410 legacy=0x7fe58c144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 >> v1:172.21.15.73:6789/0 conn(0x7fe58c144a90 legacy=0x7fe58c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c0aee80 con 0x7fe58c0a8f20 2024-09-16T14:37:19.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe57c001610 con 0x7fe58c0a8f20 2024-09-16T14:37:19.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe57c001830 con 0x7fe58c0a8f20 2024-09-16T14:37:19.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fe58a7fc700 1 -- 172.21.15.73:0/1872411110 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe57c001bc0 con 0x7fe58c0a8f20 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559631291 0 0) 0x7fc8dc0aa510 con 0x7fc8dc0726f0 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c80046e0 con 0x7fc8dc0726f0 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637533892 0 0) 0x7fc8c80046e0 con 0x7fc8dc0726f0 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 >> v1:172.21.15.177:6789/0 conn(0x7fc8dc0ae410 legacy=0x7fc8dc13a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 >> v1:172.21.15.73:6789/0 conn(0x7fc8dc13a840 legacy=0x7fc8dc0ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0aa170 con 0x7fc8dc0726f0 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8cc004d20 con 0x7fc8dc0726f0 2024-09-16T14:37:19.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fa5761dc700 1 -- 172.21.15.73:0/3150003799 >> v1:172.21.15.73:6789/0 conn(0x7fa570144a90 legacy=0x7fa57014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8cc005010 con 0x7fc8dc0726f0 2024-09-16T14:37:19.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fc8e1459700 1 -- 172.21.15.73:0/2496085332 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8cc0014b0 con 0x7fc8dc0726f0 2024-09-16T14:37:19.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.782+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fb9d001a0c0 con 0x7fb9d80ae410 2024-09-16T14:37:19.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fb9d007f8e0 con 0x7fb9d80ae410 2024-09-16T14:37:19.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd5220700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd006d860 con 0x7fbcd00ae410 2024-09-16T14:37:19.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd5220700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd01dd8d0 con 0x7fbcd0142b90 2024-09-16T14:37:19.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd5220700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd013fba0 con 0x7fbcd01487e0 2024-09-16T14:37:19.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd4a1f700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fbcd01487e0 0x7fbcd013f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51880/0 (socket says 172.21.15.73:51880) 2024-09-16T14:37:19.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd4a1f700 1 -- 172.21.15.73:0/1086181722 learned_addr learned my addr 172.21.15.73:0/1086181722 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54bb010700 1 Processor -- start 2024-09-16T14:37:19.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322621462 0 0) 0x7fbcd013fba0 con 0x7fbcd01487e0 2024-09-16T14:37:19.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcbc0035d0 con 0x7fbcd01487e0 2024-09-16T14:37:19.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920838437 0 0) 0x7f67cc152830 con 0x7f67cc0ae410 2024-09-16T14:37:19.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b80035d0 con 0x7f67cc0ae410 2024-09-16T14:37:19.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946014487 0 0) 0x7f67cc1e6230 con 0x7f67cc070db0 2024-09-16T14:37:19.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- 172.21.15.73:0/1872411110 >> v1:172.21.15.73:6790/0 conn(0x7fe58c0a8f20 legacy=0x7fe58c13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54bb010700 1 -- start start 2024-09-16T14:37:19.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67cc152830 con 0x7f67cc070db0 2024-09-16T14:37:19.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604469793 0 0) 0x7f67cc06f4f0 con 0x7f67cc0a8b60 2024-09-16T14:37:19.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67cc1e6230 con 0x7f67cc0a8b60 2024-09-16T14:37:19.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbccf7fe700 1 -- 172.21.15.73:0/1086181722 >> v1:172.21.15.177:6789/0 conn(0x7fbcd0142b90 legacy=0x7fbcd013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbccf7fe700 1 -- 172.21.15.73:0/1086181722 >> v1:172.21.15.177:6789/0 conn(0x7fbcd0142b90 legacy=0x7fbcd013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbccf7fe700 1 --1- 172.21.15.73:0/1086181722 >> v1:172.21.15.177:6789/0 conn(0x7fbcd0142b90 0x7fbcd013ed40 :-1 s=OPENED pgs=106 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbccf7fe700 1 --1- 172.21.15.73:0/1086181722 >> v1:172.21.15.177:6789/0 conn(0x7fbcd0142b90 0x7fbcd013ed40 :-1 s=OPENED pgs=106 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 -- 172.21.15.73:0/2496085332 >> v1:172.21.15.73:6790/0 conn(0x7fc8dc0726f0 legacy=0x7fc8dc0ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1019479283 0 0) 0x7fbcbc0035d0 con 0x7fbcd01487e0 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbcd013fba0 con 0x7fbcd01487e0 2024-09-16T14:37:19.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbcc00018f0 con 0x7fbcd01487e0 2024-09-16T14:37:19.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 12037786 0 0) 0x7f67cc152830 con 0x7f67cc070db0 2024-09-16T14:37:19.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 -- 172.21.15.73:0/2496085332 shutdown_connections 2024-09-16T14:37:19.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 -- 172.21.15.73:0/2496085332 >> 172.21.15.73:0/2496085332 conn(0x7fc8dc0af290 msgr2=0x7fc8dc0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f67cc06f4f0 con 0x7f67cc070db0 2024-09-16T14:37:19.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- 172.21.15.73:0/1872411110 shutdown_connections 2024-09-16T14:37:19.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- 172.21.15.73:0/1872411110 >> 172.21.15.73:0/1872411110 conn(0x7fe58c0af290 msgr2=0x7fe58c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f67c00019d0 con 0x7f67cc070db0 2024-09-16T14:37:19.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fa5761dc700 1 -- 172.21.15.73:0/3150003799 shutdown_connections 2024-09-16T14:37:19.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fa5761dc700 1 -- 172.21.15.73:0/3150003799 >> 172.21.15.73:0/3150003799 conn(0x7fa5700af290 msgr2=0x7fa5700af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- 172.21.15.73:0/1872411110 shutdown_connections 2024-09-16T14:37:19.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- 172.21.15.73:0/1872411110 wait complete. 2024-09-16T14:37:19.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 270026600 0 0) 0x7fbcd013fba0 con 0x7fbcd01487e0 2024-09-16T14:37:19.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 >> v1:172.21.15.177:6789/0 conn(0x7fbcd0142b90 legacy=0x7fbcd013ed40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:19.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 >> v1:172.21.15.73:6789/0 conn(0x7fbcd00ae410 legacy=0x7fbcd01d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd006da90 con 0x7fbcd01487e0 2024-09-16T14:37:19.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fa5761dc700 1 -- 172.21.15.73:0/3150003799 shutdown_connections 2024-09-16T14:37:19.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd5220700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd01d10d0 con 0x7fbcd01487e0 2024-09-16T14:37:19.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1725316013 0 0) 0x7f67cc06f4f0 con 0x7f67cc070db0 2024-09-16T14:37:19.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 >> v1:172.21.15.177:6789/0 conn(0x7f67cc0a8b60 legacy=0x7f67cc0706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd5220700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd01ddf40 con 0x7fbcd01487e0 2024-09-16T14:37:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fa5761dc700 1 -- 172.21.15.73:0/3150003799 wait complete. 2024-09-16T14:37:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbcc00036c0 con 0x7fbcd01487e0 2024-09-16T14:37:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbcc0003a50 con 0x7fbcd01487e0 2024-09-16T14:37:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 -- 172.21.15.73:0/2496085332 shutdown_connections 2024-09-16T14:37:19.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 -- 172.21.15.73:0/2496085332 wait complete. 2024-09-16T14:37:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fa5761dc700 1 Processor -- start 2024-09-16T14:37:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54ba00e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54b40ae410 0x7f54b413a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47204/0 (socket says 172.21.15.73:47204) 2024-09-16T14:37:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54ba00e700 1 -- 172.21.15.73:0/3275316209 learned_addr learned my addr 172.21.15.73:0/3275316209 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 Processor -- start 2024-09-16T14:37:19.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- start start 2024-09-16T14:37:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fa5761dc700 1 -- start start 2024-09-16T14:37:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15cb140700 1 Processor -- start 2024-09-16T14:37:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15cb140700 1 -- start start 2024-09-16T14:37:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15cb140700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40abc50 con 0x7f15c41487e0 2024-09-16T14:37:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15cb140700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40abf30 con 0x7f15c4142b90 2024-09-16T14:37:19.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15cb140700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40acad0 con 0x7f15c40ae410 2024-09-16T14:37:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 Processor -- start 2024-09-16T14:37:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fc8e345d700 1 -- start start 2024-09-16T14:37:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcd5220700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb0005100 con 0x7fbcd01487e0 2024-09-16T14:37:19.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fbcc0003bb0 con 0x7fbcd01487e0 2024-09-16T14:37:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40ab9d0 con 0x7f54b40ae410 2024-09-16T14:37:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40abcb0 con 0x7f54b40726f0 2024-09-16T14:37:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40aa510 con 0x7f54b40afd80 2024-09-16T14:37:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15ca93f700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f15c4142b90 0x7f15c4150b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.73:50070/0 (socket says 172.21.15.73:50070) 2024-09-16T14:37:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 >> v1:172.21.15.73:6789/0 conn(0x7f67cc0ae410 legacy=0x7f67cc089410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc1e6750 con 0x7f67cc070db0 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f67d10aa700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67cc14e760 con 0x7f67cc070db0 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f67d10aa700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f67cc089b20 con 0x7f67cc070db0 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c06e0e0 con 0x7fe58c144a90 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c139890 con 0x7fe58c0a8f20 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe592143700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c13a840 con 0x7fe58c0ae410 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe58affd700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe58c0ae410 0x7fe58c13b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51898/0 (socket says 172.21.15.73:51898) 2024-09-16T14:37:19.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7fe58affd700 1 -- 172.21.15.73:0/1385519170 learned_addr learned my addr 172.21.15.73:0/1385519170 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.786+0000 7f15ca93f700 1 -- 172.21.15.73:0/25779409 learned_addr learned my addr 172.21.15.73:0/25779409 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516898111 0 0) 0x7f54b40abcb0 con 0x7f54b40726f0 2024-09-16T14:37:19.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a00035d0 con 0x7f54b40726f0 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5761dc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57013aa80 con 0x7fa5700ae410 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5761dc700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5701412e0 con 0x7fa5700a8f20 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5761dc700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa570140d30 con 0x7fa570144a90 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5759db700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fa570144a90 0x7fa5701ee5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51912/0 (socket says 172.21.15.73:51912) 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5759db700 1 -- 172.21.15.73:0/412655570 learned_addr learned my addr 172.21.15.73:0/412655570 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701626013 0 0) 0x7fa5701412e0 con 0x7fa5700a8f20 2024-09-16T14:37:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f67d10aa700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67cc067870 con 0x7f67cc070db0 2024-09-16T14:37:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5540035d0 con 0x7fa5700a8f20 2024-09-16T14:37:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3625586531 0 0) 0x7f54a00035d0 con 0x7f54b40726f0 2024-09-16T14:37:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 >> v1:172.21.15.73:6790/0 conn(0x7f54b40afd80 legacy=0x7f54b40ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 >> v1:172.21.15.73:6789/0 conn(0x7f54b40ae410 legacy=0x7f54b413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40aa170 con 0x7f54b40726f0 2024-09-16T14:37:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2795132200 0 0) 0x7fa5540035d0 con 0x7fa5700a8f20 2024-09-16T14:37:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa5701412e0 con 0x7fa5700a8f20 2024-09-16T14:37:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa56c001880 con 0x7fa5700a8f20 2024-09-16T14:37:19.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4001610 con 0x7f54b40726f0 2024-09-16T14:37:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2853825318 0 0) 0x7fa5701412e0 con 0x7fa5700a8f20 2024-09-16T14:37:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 >> v1:172.21.15.73:6790/0 conn(0x7fa570144a90 legacy=0x7fa5701ee5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 >> v1:172.21.15.73:6789/0 conn(0x7fa5700ae410 legacy=0x7fa5701e6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570140ec0 con 0x7fa5700a8f20 2024-09-16T14:37:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5701e05f0 con 0x7fa5700a8f20 2024-09-16T14:37:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa570139e70 con 0x7fa5700a8f20 2024-09-16T14:37:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54a40018c0 con 0x7f54b40726f0 2024-09-16T14:37:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54b900c700 1 -- 172.21.15.73:0/3275316209 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4001c90 con 0x7f54b40726f0 2024-09-16T14:37:19.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa56c0036a0 con 0x7fa5700a8f20 2024-09-16T14:37:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa56c0039b0 con 0x7fa5700a8f20 2024-09-16T14:37:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 >> v1:172.21.15.177:6789/0 conn(0x7f54b40726f0 legacy=0x7f54b40ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa550005100 con 0x7fa5700a8f20 2024-09-16T14:37:19.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fb9d004cf80 con 0x7fb9d80ae410 2024-09-16T14:37:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059861742 0 0) 0x7f15c40abf30 con 0x7f15c4142b90 2024-09-16T14:37:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b00035d0 con 0x7f15c4142b90 2024-09-16T14:37:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281782310 0 0) 0x7f15c40abc50 con 0x7f15c41487e0 2024-09-16T14:37:19.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c40abf30 con 0x7f15c41487e0 2024-09-16T14:37:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 shutdown_connections 2024-09-16T14:37:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 >> 172.21.15.73:0/3275316209 conn(0x7f54b40af290 msgr2=0x7f54b40af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8e345d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc13e630 con 0x7fc8dc13a840 2024-09-16T14:37:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8e345d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc140ff0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8e345d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc06e090 con 0x7fc8dc0726f0 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8e2c5c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc8dc13a840 0x7fc8dc13f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47248/0 (socket says 172.21.15.73:47248) 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8e2c5c700 1 -- 172.21.15.73:0/3455607764 learned_addr learned my addr 172.21.15.73:0/3455607764 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062789928 0 0) 0x7fc8dc140ff0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c00035d0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281444134 0 0) 0x7fc8dc13e630 con 0x7fc8dc13a840 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc140ff0 con 0x7fc8dc13a840 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1135519524 0 0) 0x7fc8dc140ff0 con 0x7fc8dc13a840 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8dc13e630 con 0x7fc8dc13a840 2024-09-16T14:37:19.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fbcc007f540 con 0x7fbcd01487e0 2024-09-16T14:37:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.790+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8d4001a50 con 0x7fc8dc13a840 2024-09-16T14:37:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2631236996 0 0) 0x7f15c40abf30 con 0x7f15c41487e0 2024-09-16T14:37:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 >> v1:172.21.15.73:6790/0 conn(0x7f15c40ae410 legacy=0x7f15c40ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 >> v1:172.21.15.177:6789/0 conn(0x7f15c4142b90 legacy=0x7f15c4150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40aaf20 con 0x7f15c41487e0 2024-09-16T14:37:19.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f15b40014c0 con 0x7f15c41487e0 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 55308535 0 0) 0x7fc8c00035d0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8dc140ff0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8cc004ce0 con 0x7fc8dc0ae410 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2434703081 0 0) 0x7fc8dc13e630 con 0x7fc8dc13a840 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 >> v1:172.21.15.73:6790/0 conn(0x7fc8dc0726f0 legacy=0x7fc8dc1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 >> v1:172.21.15.177:6789/0 conn(0x7fc8dc0ae410 legacy=0x7fc8dc13eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15b40016e0 con 0x7f15c41487e0 2024-09-16T14:37:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc06e370 con 0x7fc8dc13a840 2024-09-16T14:37:19.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15c913c700 1 -- 172.21.15.73:0/25779409 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f15b40019f0 con 0x7f15c41487e0 2024-09-16T14:37:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523501658 0 0) 0x7fe58c139890 con 0x7fe58c0a8f20 2024-09-16T14:37:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5780035d0 con 0x7fe58c0a8f20 2024-09-16T14:37:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039104643 0 0) 0x7fe58c06e0e0 con 0x7fe58c144a90 2024-09-16T14:37:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe58c139890 con 0x7fe58c144a90 2024-09-16T14:37:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fa56c018b50 con 0x7fa5700a8f20 2024-09-16T14:37:19.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 shutdown_connections 2024-09-16T14:37:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fa56c07e3c0 con 0x7fa5700a8f20 2024-09-16T14:37:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15cb140700 1 -- 172.21.15.73:0/25779409 >> v1:172.21.15.73:6789/0 conn(0x7f15c41487e0 legacy=0x7f15c4142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc13e230 con 0x7fc8dc13a840 2024-09-16T14:37:19.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc1e5850 con 0x7fc8dc13a840 2024-09-16T14:37:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8d4001cc0 con 0x7fc8dc13a840 2024-09-16T14:37:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8d4004e30 con 0x7fc8dc13a840 2024-09-16T14:37:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15cb140700 1 -- 172.21.15.73:0/25779409 shutdown_connections 2024-09-16T14:37:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15cb140700 1 -- 172.21.15.73:0/25779409 >> 172.21.15.73:0/25779409 conn(0x7f15c40af290 msgr2=0x7f15c40af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 23023787 0 0) 0x7fe58c139890 con 0x7fe58c144a90 2024-09-16T14:37:19.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe58c06e0e0 con 0x7fe58c144a90 2024-09-16T14:37:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe5800016c0 con 0x7fe58c144a90 2024-09-16T14:37:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 -- 172.21.15.73:0/3275316209 wait complete. 2024-09-16T14:37:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 Processor -- start 2024-09-16T14:37:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 -- start start 2024-09-16T14:37:19.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15cb140700 1 -- 172.21.15.73:0/25779409 shutdown_connections 2024-09-16T14:37:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15cb140700 1 -- 172.21.15.73:0/25779409 wait complete. 2024-09-16T14:37:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c4005100 con 0x7fc8dc13a840 2024-09-16T14:37:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 891556848 0 0) 0x7fe58c06e0e0 con 0x7fe58c144a90 2024-09-16T14:37:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 >> v1:172.21.15.73:6790/0 conn(0x7fe58c0ae410 legacy=0x7fe58c13b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4140380 con 0x7f54b40726f0 2024-09-16T14:37:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4140c90 con 0x7f54b40afd80 2024-09-16T14:37:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54bb010700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4140f70 con 0x7f54b40ae410 2024-09-16T14:37:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 >> v1:172.21.15.177:6789/0 conn(0x7fe58c0a8f20 legacy=0x7fe58c13ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c072110 con 0x7fe58c144a90 2024-09-16T14:37:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c13a460 con 0x7fe58c144a90 2024-09-16T14:37:19.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c141730 con 0x7fe58c144a90 2024-09-16T14:37:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fc8d4019fd0 con 0x7fc8dc13a840 2024-09-16T14:37:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54ba00e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54b40726f0 0x7f54b413fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47258/0 (socket says 172.21.15.73:47258) 2024-09-16T14:37:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f54ba00e700 1 -- 172.21.15.73:0/3856780279 learned_addr learned my addr 172.21.15.73:0/3856780279 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fc8d407f8b0 con 0x7fc8dc13a840 2024-09-16T14:37:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.794+0000 7f15cb140700 1 Processor -- start 2024-09-16T14:37:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7f15cb140700 1 -- start start 2024-09-16T14:37:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fbcc004cd20 con 0x7fbcd01487e0 2024-09-16T14:37:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895043299 0 0) 0x7f54b4140380 con 0x7f54b40726f0 2024-09-16T14:37:19.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54980035d0 con 0x7f54b40726f0 2024-09-16T14:37:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe580001c10 con 0x7fe58c144a90 2024-09-16T14:37:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe580001d80 con 0x7fe58c144a90 2024-09-16T14:37:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fe5800038e0 con 0x7fe58c144a90 2024-09-16T14:37:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.798+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fe58007e1b0 con 0x7fe58c144a90 2024-09-16T14:37:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f67c0000f30 con 0x7f67cc070db0 2024-09-16T14:37:19.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f67c00010a0 con 0x7f67cc070db0 2024-09-16T14:37:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f67c0019d20 con 0x7f67cc070db0 2024-09-16T14:37:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f15ca13e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f15c40ae410 0x7f15c41dd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47266/0 (socket says 172.21.15.73:47266) 2024-09-16T14:37:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f15ca13e700 1 -- 172.21.15.73:0/3957800853 learned_addr learned my addr 172.21.15.73:0/3957800853 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:19.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c413bb20 con 0x7f15c40ae410 2024-09-16T14:37:19.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40b2240 con 0x7f15c4142b90 2024-09-16T14:37:19.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c4147680 con 0x7f15c41487e0 2024-09-16T14:37:19.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c005100 con 0x7fe58c144a90 2024-09-16T14:37:19.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f67c007f450 con 0x7f67cc070db0 2024-09-16T14:37:19.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229145830 0 0) 0x7f54b4140f70 con 0x7f54b40ae410 2024-09-16T14:37:19.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b4140380 con 0x7f54b40ae410 2024-09-16T14:37:19.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f67c004cc50 con 0x7f67cc070db0 2024-09-16T14:37:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3930192918 0 0) 0x7f54b4140380 con 0x7f54b40ae410 2024-09-16T14:37:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54b4140f70 con 0x7f54b40ae410 2024-09-16T14:37:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4001c10 con 0x7f54b40ae410 2024-09-16T14:37:19.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4192089980 0 0) 0x7f54b4140f70 con 0x7f54b40ae410 2024-09-16T14:37:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.177:6789/0 conn(0x7f54b40afd80 legacy=0x7f54b413c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6789/0 conn(0x7f54b40726f0 legacy=0x7f54b413fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b41417f0 con 0x7f54b40ae410 2024-09-16T14:37:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54a4003ad0 con 0x7f54b40ae410 2024-09-16T14:37:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54a4003e60 con 0x7f54b40ae410 2024-09-16T14:37:19.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.802+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fa56c04b9d0 con 0x7fa5700a8f20 2024-09-16T14:37:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518090809 0 0) 0x7f15c4147680 con 0x7f15c41487e0 2024-09-16T14:37:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a80035d0 con 0x7f15c41487e0 2024-09-16T14:37:19.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577438162 0 0) 0x7f15c40b2240 con 0x7f15c4142b90 2024-09-16T14:37:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c4147680 con 0x7f15c4142b90 2024-09-16T14:37:19.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fc8d404cec0 con 0x7fc8dc13a840 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136810096 0 0) 0x7f15c413bb20 con 0x7f15c40ae410 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.806+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c40b2240 con 0x7f15c40ae410 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3340556522 0 0) 0x7f15c4147680 con 0x7f15c4142b90 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15c413bb20 con 0x7f15c4142b90 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f15b4001220 con 0x7f15c4142b90 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2967734398 0 0) 0x7f15c413bb20 con 0x7f15c4142b90 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 >> v1:172.21.15.73:6790/0 conn(0x7f15c41487e0 legacy=0x7f15c413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 >> v1:172.21.15.73:6789/0 conn(0x7f15c40ae410 legacy=0x7f15c41dd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40b07b0 con 0x7f15c4142b90 2024-09-16T14:37:19.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15b4001530 con 0x7f15c4142b90 2024-09-16T14:37:19.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.810+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f15b4003b70 con 0x7f15c4142b90 2024-09-16T14:37:19.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b413eed0 con 0x7f54b40ae410 2024-09-16T14:37:19.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c41dd770 con 0x7f15c4142b90 2024-09-16T14:37:19.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c413d790 con 0x7f15c4142b90 2024-09-16T14:37:19.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b41e3600 con 0x7f54b40ae410 2024-09-16T14:37:19.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fe58004b860 con 0x7fe58c144a90 2024-09-16T14:37:19.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4067870 con 0x7f54b40ae410 2024-09-16T14:37:19.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f15b4018d90 con 0x7f15c4142b90 2024-09-16T14:37:19.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.814+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f15b407e3a0 con 0x7f15c4142b90 2024-09-16T14:37:19.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.818+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4067870 con 0x7f15c4142b90 2024-09-16T14:37:19.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.818+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f54a4004090 con 0x7f54b40ae410 2024-09-16T14:37:19.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.818+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f54a407e620 con 0x7f54b40ae410 2024-09-16T14:37:19.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.822+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f15b404bb20 con 0x7f15c4142b90 2024-09-16T14:37:19.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:19.826+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f54a404bbd0 con 0x7f54b40ae410 2024-09-16T14:37:20.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.106+0000 7fbcd5220700 1 -- 172.21.15.73:0/1086181722 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcb00053b0 con 0x7fbcd01487e0 2024-09-16T14:37:20.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.106+0000 7fbcccff9700 1 -- 172.21.15.73:0/1086181722 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 326014871) 0x7fbcc004ec50 con 0x7fbcd01487e0 2024-09-16T14:37:20.113 INFO:teuthology.orchestra.run.smithi073.stdout:60129542146 2024-09-16T14:37:20.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb9d8140e50 con 0x7fb9d80ae410 2024-09-16T14:37:20.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5500053b0 con 0x7fa5700a8f20 2024-09-16T14:37:20.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fbcb67fc700 1 -- 172.21.15.73:0/1086181722 >> v1:172.21.15.177:6816/2823028339 conn(0x7fbcbc067310 legacy=0x7fbcbc0697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fbcb67fc700 1 -- 172.21.15.73:0/1086181722 >> v1:172.21.15.73:6790/0 conn(0x7fbcd01487e0 legacy=0x7fbcd013f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fbcb67fc700 1 -- 172.21.15.73:0/1086181722 shutdown_connections 2024-09-16T14:37:20.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fbcb67fc700 1 -- 172.21.15.73:0/1086181722 >> 172.21.15.73:0/1086181722 conn(0x7fbcd00af290 msgr2=0x7fbcd0148c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fb9c7fff700 1 -- 172.21.15.73:0/3551863706 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 2439918515) 0x7fb9d004f080 con 0x7fb9d80ae410 2024-09-16T14:37:20.117 INFO:teuthology.orchestra.run.smithi073.stdout:55834574850 2024-09-16T14:37:20.117 INFO:teuthology.orchestra.run.smithi073.stdout:60129542147 2024-09-16T14:37:20.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fa565ffb700 1 -- 172.21.15.73:0/412655570 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 13373408) 0x7fa56c04dad0 con 0x7fa5700a8f20 2024-09-16T14:37:20.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.110+0000 7fbcb67fc700 1 -- 172.21.15.73:0/1086181722 shutdown_connections 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fbcb67fc700 1 -- 172.21.15.73:0/1086181722 wait complete. 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 >> v1:172.21.15.177:6816/2823028339 conn(0x7fb9bc0675c0 legacy=0x7fb9bc069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 >> v1:172.21.15.73:6789/0 conn(0x7fb9d80ae410 legacy=0x7fb9d81377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 shutdown_connections 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 >> 172.21.15.73:0/3551863706 conn(0x7fb9d80af290 msgr2=0x7fb9d813ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 shutdown_connections 2024-09-16T14:37:20.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.114+0000 7fb9dcf96700 1 -- 172.21.15.73:0/3551863706 wait complete. 2024-09-16T14:37:20.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.118+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 >> v1:172.21.15.177:6816/2823028339 conn(0x7fa5540671e0 legacy=0x7fa5540696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.118+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 >> v1:172.21.15.177:6789/0 conn(0x7fa5700a8f20 legacy=0x7fa5701dfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.118+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 shutdown_connections 2024-09-16T14:37:20.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.118+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 >> 172.21.15.73:0/412655570 conn(0x7fa5700af290 msgr2=0x7fa57013e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.122+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 shutdown_connections 2024-09-16T14:37:20.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.122+0000 7fa5761dc700 1 -- 172.21.15.73:0/412655570 wait complete. 2024-09-16T14:37:20.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.122+0000 7f67d10aa700 1 -- 172.21.15.73:0/2090119970 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f67cc152d50 con 0x7f67cc070db0 2024-09-16T14:37:20.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.122+0000 7f67c8ff9700 1 -- 172.21.15.73:0/2090119970 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (unknown 1482059429 0 2439918515) 0x7f67cc152d50 con 0x7f67cc070db0 2024-09-16T14:37:20.125 INFO:teuthology.orchestra.run.smithi073.stdout:55834574850 2024-09-16T14:37:20.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.126+0000 7f67b27fc700 1 -- 172.21.15.73:0/2090119970 >> v1:172.21.15.177:6816/2823028339 conn(0x7f67b8067310 legacy=0x7f67b80697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.126+0000 7f67b27fc700 1 -- 172.21.15.73:0/2090119970 >> v1:172.21.15.73:6790/0 conn(0x7f67cc070db0 legacy=0x7f67cc1ede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.126+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe56c0053b0 con 0x7fe58c144a90 2024-09-16T14:37:20.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.126+0000 7f67b27fc700 1 -- 172.21.15.73:0/2090119970 shutdown_connections 2024-09-16T14:37:20.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.126+0000 7f67b27fc700 1 -- 172.21.15.73:0/2090119970 >> 172.21.15.73:0/2090119970 conn(0x7f67cc0af290 msgr2=0x7f67cc0b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.126+0000 7fe573fff700 1 -- 172.21.15.73:0/1385519170 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (unknown 1823589948 0 2439918515) 0x7fe58004d960 con 0x7fe58c144a90 2024-09-16T14:37:20.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.1 2024-09-16T14:37:20.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7f67b27fc700 1 -- 172.21.15.73:0/2090119970 shutdown_connections 2024-09-16T14:37:20.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7f67b27fc700 1 -- 172.21.15.73:0/2090119970 wait complete. 2024-09-16T14:37:20.134 INFO:teuthology.orchestra.run.smithi073.stdout:55834574850 2024-09-16T14:37:20.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 >> v1:172.21.15.177:6816/2823028339 conn(0x7fe578067580 legacy=0x7fe578069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 >> v1:172.21.15.73:6789/0 conn(0x7fe58c144a90 legacy=0x7fe58c1fe270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 shutdown_connections 2024-09-16T14:37:20.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 >> 172.21.15.73:0/1385519170 conn(0x7fe58c0af290 msgr2=0x7fe58c0aa640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 shutdown_connections 2024-09-16T14:37:20.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.130+0000 7fe592143700 1 -- 172.21.15.73:0/1385519170 wait complete. 2024-09-16T14:37:20.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.134+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f15c40b0380 con 0x7f15c4142b90 2024-09-16T14:37:20.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.134+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc8c40053b0 con 0x7fc8dc13a840 2024-09-16T14:37:20.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.134+0000 7fc8d2ffd700 1 -- 172.21.15.73:0/3455607764 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (unknown 2131975755 0 2439918515) 0x7fc8d404efc0 con 0x7fc8dc13a840 2024-09-16T14:37:20.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.134+0000 7f15baffd700 1 -- 172.21.15.73:0/3957800853 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (unknown 1274345170 0 326014871) 0x7f15c40b0380 con 0x7f15c4142b90 2024-09-16T14:37:20.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2024-09-16T14:37:20.140 INFO:teuthology.orchestra.run.smithi073.stdout:55834574850 2024-09-16T14:37:20.140 INFO:teuthology.orchestra.run.smithi073.stdout:60129542146 2024-09-16T14:37:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 >> v1:172.21.15.177:6816/2823028339 conn(0x7f15a8067460 legacy=0x7f15a8069920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 >> v1:172.21.15.177:6789/0 conn(0x7f15c4142b90 legacy=0x7f15c413ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 shutdown_connections 2024-09-16T14:37:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 >> 172.21.15.73:0/3957800853 conn(0x7f15c40af290 msgr2=0x7f15c4148c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 shutdown_connections 2024-09-16T14:37:20.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7f15cb140700 1 -- 172.21.15.73:0/3957800853 wait complete. 2024-09-16T14:37:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 >> v1:172.21.15.177:6816/2823028339 conn(0x7fc8c0067350 legacy=0x7fc8c0069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 >> v1:172.21.15.73:6789/0 conn(0x7fc8dc13a840 legacy=0x7fc8dc13f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 shutdown_connections 2024-09-16T14:37:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 >> 172.21.15.73:0/3455607764 conn(0x7fc8dc0af290 msgr2=0x7fc8dc13a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 shutdown_connections 2024-09-16T14:37:20.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.138+0000 7fc8e345d700 1 -- 172.21.15.73:0/3455607764 wait complete. 2024-09-16T14:37:20.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.2 2024-09-16T14:37:20.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2024-09-16T14:37:20.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f54b4067c30 con 0x7f54b40ae410 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54b980d700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6790/0 conn(0x7f54b40ae410 legacy=0x7f54b41e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54b980d700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6790/0 conn(0x7f54b40ae410 legacy=0x7f54b41e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54b980d700 1 --1- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6790/0 conn(0x7f54b40ae410 0x7f54b41e2d10 :-1 s=OPENED pgs=117 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54b980d700 1 --1- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6790/0 conn(0x7f54b40ae410 0x7f54b41e2d10 :-1 s=OPENED pgs=117 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6790/0 conn(0x7f54b40ae410 legacy=0x7f54b41e2d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f54b4140f70 con 0x7f54b40726f0 2024-09-16T14:37:20.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f54b4140380 con 0x7f54b40afd80 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f549807b7b0 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230339892 0 0) 0x7f54b4140f70 con 0x7f54b40726f0 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6789/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f549807b940 con 0x7f54b40726f0 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823494874 0 0) 0x7f549807b7b0 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f54b4140f70 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (unknown 3636979127 0 0) 0x7f54b4140f70 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.177:6789/0 conn(0x7f54b40afd80 legacy=0x7f5498073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6789/0 conn(0x7f54b40726f0 legacy=0x7f54980700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7f549807ca30 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f549807b940 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54b0001af0 con 0x7f5498075670 2024-09-16T14:37:20.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.146+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54b0001c50 con 0x7f5498075670 2024-09-16T14:37:20.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.150+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f54b0004870 con 0x7f5498075670 2024-09-16T14:37:20.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.150+0000 7f54aaffd700 1 -- 172.21.15.73:0/3856780279 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 326014871) 0x7f54b0080220 con 0x7f5498075670 2024-09-16T14:37:20.154 INFO:teuthology.orchestra.run.smithi073.stdout:60129542146 2024-09-16T14:37:20.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.5 2024-09-16T14:37:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.154+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.177:6816/2823028339 conn(0x7f54980672f0 legacy=0x7f54980697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.154+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 >> v1:172.21.15.73:6790/0 conn(0x7f5498075670 legacy=0x7f5498077b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.154+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 shutdown_connections 2024-09-16T14:37:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.154+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 >> 172.21.15.73:0/3856780279 conn(0x7f54b40af290 msgr2=0x7f54b41349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.154+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 shutdown_connections 2024-09-16T14:37:20.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:20.154+0000 7f54bb010700 1 -- 172.21.15.73:0/3856780279 wait complete. 2024-09-16T14:37:20.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.6 2024-09-16T14:37:20.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.0 2024-09-16T14:37:21.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T14:37:21.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T14:37:21.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T14:37:21.148 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T14:37:21.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T14:37:21.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T14:37:21.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T14:37:21.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T14:37:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4ab84700 1 Processor -- start 2024-09-16T14:37:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4ab84700 1 -- start start 2024-09-16T14:37:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4ab84700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0cc4e0 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4ab84700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c032710 con 0x7f0b3c0343d0 2024-09-16T14:37:21.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4ab84700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c032980 con 0x7f0b3c0c8860 2024-09-16T14:37:21.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4a383700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0b3c0ccc90 0x7f0b3c0cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47294/0 (socket says 172.21.15.73:47294) 2024-09-16T14:37:21.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.262+0000 7f0b4a383700 1 -- 172.21.15.73:0/3393512884 learned_addr learned my addr 172.21.15.73:0/3393512884 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178600399 0 0) 0x7f0b3c0cc4e0 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b300035d0 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404617873 0 0) 0x7f0b3c032710 con 0x7f0b3c0343d0 2024-09-16T14:37:21.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b3c0cc4e0 con 0x7f0b3c0343d0 2024-09-16T14:37:21.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347180144 0 0) 0x7f0b3c032980 con 0x7f0b3c0c8860 2024-09-16T14:37:21.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b3c032710 con 0x7f0b3c0c8860 2024-09-16T14:37:21.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3493233995 0 0) 0x7f0b300035d0 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 >> v1:172.21.15.73:6790/0 conn(0x7f0b3c0c8860 legacy=0x7f0b3c0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 >> v1:172.21.15.177:6789/0 conn(0x7f0b3c0343d0 legacy=0x7f0b3c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c0cd7d0 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0b40001590 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b48b80700 1 -- 172.21.15.73:0/3393512884 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0b40001820 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3393512884 >> v1:172.21.15.73:6789/0 conn(0x7f0b3c0ccc90 legacy=0x7f0b3c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3393512884 shutdown_connections 2024-09-16T14:37:21.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3393512884 >> 172.21.15.73:0/3393512884 conn(0x7f0b3c005510 msgr2=0x7f0b3c005920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3393512884 shutdown_connections 2024-09-16T14:37:21.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.266+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3393512884 wait complete. 2024-09-16T14:37:21.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4ab84700 1 Processor -- start 2024-09-16T14:37:21.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4ab84700 1 -- start start 2024-09-16T14:37:21.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4ab84700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0a0940 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4ab84700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0a0c20 con 0x7f0b3c0343d0 2024-09-16T14:37:21.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4ab84700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c02a760 con 0x7f0b3c0c8860 2024-09-16T14:37:21.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4a383700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0b3c0ccc90 0x7f0b3c16b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47298/0 (socket says 172.21.15.73:47298) 2024-09-16T14:37:21.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b4a383700 1 -- 172.21.15.73:0/3862419342 learned_addr learned my addr 172.21.15.73:0/3862419342 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415135986 0 0) 0x7f0b3c0a0c20 con 0x7f0b3c0343d0 2024-09-16T14:37:21.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b30005630 con 0x7f0b3c0343d0 2024-09-16T14:37:21.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160142764 0 0) 0x7f0b3c0a0940 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.270+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b3c0a0c20 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130223454 0 0) 0x7f0b3c02a760 con 0x7f0b3c0c8860 2024-09-16T14:37:21.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b3c0a0940 con 0x7f0b3c0c8860 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3060674278 0 0) 0x7f0b30005630 con 0x7f0b3c0343d0 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b3c02a760 con 0x7f0b3c0343d0 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2271466282 0 0) 0x7f0b3c0a0c20 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b30005630 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0b4404ec20 con 0x7f0b3c0343d0 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2818798687 0 0) 0x7f0b3c0a0940 con 0x7f0b3c0c8860 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b3c0a0c20 con 0x7f0b3c0c8860 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0b40001d50 con 0x7f0b3c0ccc90 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1135429932 0 0) 0x7f0b3c02a760 con 0x7f0b3c0343d0 2024-09-16T14:37:21.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 >> v1:172.21.15.73:6790/0 conn(0x7f0b3c0c8860 legacy=0x7f0b3c0c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 >> v1:172.21.15.73:6789/0 conn(0x7f0b3c0ccc90 legacy=0x7f0b3c16b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c02eeb0 con 0x7f0b3c0343d0 2024-09-16T14:37:21.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c02a310 con 0x7f0b3c0343d0 2024-09-16T14:37:21.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c02e550 con 0x7f0b3c0343d0 2024-09-16T14:37:21.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0b44069410 con 0x7f0b3c0343d0 2024-09-16T14:37:21.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.274+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0b440663f0 con 0x7f0b3c0343d0 2024-09-16T14:37:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.278+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f0b44069630 con 0x7f0b3c0343d0 2024-09-16T14:37:21.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.278+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f0b440f7fa0 con 0x7f0b3c0343d0 2024-09-16T14:37:21.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.282+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2c005100 con 0x7f0b3c0343d0 2024-09-16T14:37:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32f0d1700 1 Processor -- start 2024-09-16T14:37:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32f0d1700 1 -- start start 2024-09-16T14:37:21.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f0b440c5720 con 0x7f0b3c0343d0 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32f0d1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280aa1b0 con 0x7fc3280a8f20 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32f0d1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280a8a00 con 0x7fc328144a90 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32f0d1700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280aecf0 con 0x7fc3280ae410 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32e0cf700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc3280ae410 0x7fc328144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51980/0 (socket says 172.21.15.73:51980) 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fc32e0cf700 1 -- 172.21.15.73:0/1201756964 learned_addr learned my addr 172.21.15.73:0/1201756964 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745869437 0 0) 0x7fc3280aecf0 con 0x7fc3280ae410 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3140035d0 con 0x7fc3280ae410 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284599785 0 0) 0x7fc3140035d0 con 0x7fc3280ae410 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 >> v1:172.21.15.177:6789/0 conn(0x7fc328144a90 legacy=0x7fc32814c720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T14:37:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 >> v1:172.21.15.73:6789/0 conn(0x7fc3280a8f20 legacy=0x7fc32813e040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fbf3eefb700 1 Processor -- start 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.290+0000 7fbf3eefb700 1 -- start start 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3eefb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380abc50 con 0x7fbf381487e0 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3eefb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380abf30 con 0x7fbf380ae410 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3eefb700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380acad0 con 0x7fbf38142b90 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3e6fa700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fbf38142b90 0x7fbf38150b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:51992/0 (socket says 172.21.15.73:51992) 2024-09-16T14:37:21.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3e6fa700 1 -- 172.21.15.73:0/3879248087 learned_addr learned my addr 172.21.15.73:0/3879248087 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280aee80 con 0x7fc3280ae410 2024-09-16T14:37:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc3240015f0 con 0x7fc3280ae410 2024-09-16T14:37:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc3240018e0 con 0x7fc3280ae410 2024-09-16T14:37:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32d0cd700 1 -- 172.21.15.73:0/1201756964 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc324001cb0 con 0x7fc3280ae410 2024-09-16T14:37:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291498215 0 0) 0x7fbf380abf30 con 0x7fbf380ae410 2024-09-16T14:37:21.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf240035d0 con 0x7fbf380ae410 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777241716 0 0) 0x7fbf380acad0 con 0x7fbf38142b90 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf380abf30 con 0x7fbf38142b90 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3537405580 0 0) 0x7fbf240035d0 con 0x7fbf380ae410 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 >> v1:172.21.15.73:6790/0 conn(0x7fbf38142b90 legacy=0x7fbf38150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 >> v1:172.21.15.73:6789/0 conn(0x7fbf381487e0 legacy=0x7fbf38142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380aaf20 con 0x7fbf380ae410 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbf34001610 con 0x7fbf380ae410 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 <== mon.1 v1:172.21.15.177:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbf340017e0 con 0x7fbf380ae410 2024-09-16T14:37:21.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3cef7700 1 -- 172.21.15.73:0/3879248087 <== mon.1 v1:172.21.15.177:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbf34001b70 con 0x7fbf380ae410 2024-09-16T14:37:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1201756964 >> v1:172.21.15.73:6790/0 conn(0x7fc3280ae410 legacy=0x7fc328144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1201756964 shutdown_connections 2024-09-16T14:37:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1201756964 >> 172.21.15.73:0/1201756964 conn(0x7fc3280af290 msgr2=0x7fc3280af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1201756964 shutdown_connections 2024-09-16T14:37:21.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1201756964 wait complete. 2024-09-16T14:37:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3879248087 >> v1:172.21.15.177:6789/0 conn(0x7fbf380ae410 legacy=0x7fbf380ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3879248087 shutdown_connections 2024-09-16T14:37:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3879248087 >> 172.21.15.73:0/3879248087 conn(0x7fbf380af290 msgr2=0x7fbf380af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7ff07e5e3700 1 Processor -- start 2024-09-16T14:37:21.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.294+0000 7ff07e5e3700 1 -- start start 2024-09-16T14:37:21.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 Processor -- start 2024-09-16T14:37:21.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 -- start start 2024-09-16T14:37:21.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3879248087 shutdown_connections 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3281382f0 con 0x7fc3280ae410 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328140780 con 0x7fc328144a90 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328143a70 con 0x7fc3280a8f20 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32d8ce700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc3280ae410 0x7fc3281374d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47328/0 (socket says 172.21.15.73:47328) 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32d8ce700 1 -- 172.21.15.73:0/1442435571 learned_addr learned my addr 172.21.15.73:0/1442435571 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160084103 0 0) 0x7fc3281382f0 con 0x7fc3280ae410 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc30c0035d0 con 0x7fc3280ae410 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085561142 0 0) 0x7fc328143a70 con 0x7fc3280a8f20 2024-09-16T14:37:21.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3281382f0 con 0x7fc3280a8f20 2024-09-16T14:37:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff07e5e3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0780aa1b0 con 0x7ff0780ae410 2024-09-16T14:37:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff07e5e3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0780a8a00 con 0x7ff0780a8f20 2024-09-16T14:37:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff07e5e3700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0780aecf0 con 0x7ff078144a90 2024-09-16T14:37:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 652940002 0 0) 0x7fc3281382f0 con 0x7fc3280a8f20 2024-09-16T14:37:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc328143a70 con 0x7fc3280a8f20 2024-09-16T14:37:21.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc324001410 con 0x7fc3280a8f20 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1964888140 0 0) 0x7fc30c0035d0 con 0x7fc3280ae410 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3281382f0 con 0x7fc3280ae410 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc318001860 con 0x7fc3280ae410 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3879248087 wait complete. 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 Processor -- start 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff07d5e1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 0x7ff078144380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47344/0 (socket says 172.21.15.73:47344) 2024-09-16T14:37:21.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff07d5e1700 1 -- 172.21.15.73:0/4031972501 learned_addr learned my addr 172.21.15.73:0/4031972501 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 984678308 0 0) 0x7fc328143a70 con 0x7fc3280a8f20 2024-09-16T14:37:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 >> v1:172.21.15.177:6789/0 conn(0x7fc328144a90 legacy=0x7fc328137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 >> v1:172.21.15.73:6789/0 conn(0x7fc3280ae410 legacy=0x7fc3281374d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328140ca0 con 0x7fc3280a8f20 2024-09-16T14:37:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3281403a0 con 0x7fc3280a8f20 2024-09-16T14:37:21.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3281d6550 con 0x7fc3280a8f20 2024-09-16T14:37:21.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226046141 0 0) 0x7ff0780aa1b0 con 0x7ff0780ae410 2024-09-16T14:37:21.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0640035d0 con 0x7ff0780ae410 2024-09-16T14:37:21.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339685182 0 0) 0x7ff0640035d0 con 0x7ff0780ae410 2024-09-16T14:37:21.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 >> v1:172.21.15.73:6790/0 conn(0x7ff078144a90 legacy=0x7ff07814c720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T14:37:21.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 >> v1:172.21.15.177:6789/0 conn(0x7ff0780a8f20 legacy=0x7ff07813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780aee80 con 0x7ff0780ae410 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 -- start start 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf381450c0 con 0x7fbf380ae410 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380b20c0 con 0x7fbf38142b90 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3eefb700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf38145c60 con 0x7fbf381487e0 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3def9700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbf380ae410 0x7fbf38144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47358/0 (socket says 172.21.15.73:47358) 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf3def9700 1 -- 172.21.15.73:0/3451561799 learned_addr learned my addr 172.21.15.73:0/3451561799 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff070001990 con 0x7ff0780ae410 2024-09-16T14:37:21.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff070001cf0 con 0x7ff0780ae410 2024-09-16T14:37:21.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7ff06ffff700 1 -- 172.21.15.73:0/4031972501 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff070002080 con 0x7ff0780ae410 2024-09-16T14:37:21.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.298+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081712185 0 0) 0x7fbf381450c0 con 0x7fbf380ae410 2024-09-16T14:37:21.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf1c0035d0 con 0x7fbf380ae410 2024-09-16T14:37:21.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262031150 0 0) 0x7fbf38145c60 con 0x7fbf381487e0 2024-09-16T14:37:21.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc324004ca0 con 0x7fc3280a8f20 2024-09-16T14:37:21.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc324004fb0 con 0x7fc3280a8f20 2024-09-16T14:37:21.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fc32401a150 con 0x7fc3280a8f20 2024-09-16T14:37:21.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf381450c0 con 0x7fbf381487e0 2024-09-16T14:37:21.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 533605085 0 0) 0x7fbf1c0035d0 con 0x7fbf380ae410 2024-09-16T14:37:21.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbf38145c60 con 0x7fbf380ae410 2024-09-16T14:37:21.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbf34001550 con 0x7fbf380ae410 2024-09-16T14:37:21.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 -- 172.21.15.73:0/4031972501 >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 legacy=0x7ff078144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2088434974 0 0) 0x7fbf38145c60 con 0x7fbf380ae410 2024-09-16T14:37:21.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 >> v1:172.21.15.73:6790/0 conn(0x7fbf381487e0 legacy=0x7fbf38135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 -- 172.21.15.73:0/4031972501 shutdown_connections 2024-09-16T14:37:21.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 -- 172.21.15.73:0/4031972501 >> 172.21.15.73:0/4031972501 conn(0x7ff0780af290 msgr2=0x7ff0780af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fc3240515b0 con 0x7fc3280a8f20 2024-09-16T14:37:21.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 -- 172.21.15.73:0/4031972501 shutdown_connections 2024-09-16T14:37:21.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 -- 172.21.15.73:0/4031972501 wait complete. 2024-09-16T14:37:21.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 >> v1:172.21.15.177:6789/0 conn(0x7fbf38142b90 legacy=0x7fbf38145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38145df0 con 0x7fbf380ae410 2024-09-16T14:37:21.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf381430e0 con 0x7fbf380ae410 2024-09-16T14:37:21.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf380b1860 con 0x7fbf380ae410 2024-09-16T14:37:21.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf38067870 con 0x7fbf380ae410 2024-09-16T14:37:21.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 Processor -- start 2024-09-16T14:37:21.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.302+0000 7ff07e5e3700 1 -- start start 2024-09-16T14:37:21.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.306+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310005100 con 0x7fc3280a8f20 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.306+0000 7ff07e5e3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07813fc90 con 0x7ff0780ae410 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.306+0000 7ff07e5e3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07813fee0 con 0x7ff0780a8f20 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.306+0000 7ff07e5e3700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0781382d0 con 0x7ff078144a90 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.306+0000 7ff07dde2700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7ff078144a90 0x7ff0781d6410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52028/0 (socket says 172.21.15.73:52028) 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.306+0000 7ff07dde2700 1 -- 172.21.15.73:0/3553605169 learned_addr learned my addr 172.21.15.73:0/3553605169 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104157918 0 0) 0x7ff07813fee0 con 0x7ff0780a8f20 2024-09-16T14:37:21.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff05c0035d0 con 0x7ff0780a8f20 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028619682 0 0) 0x7ff07813fc90 con 0x7ff0780ae410 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07813fee0 con 0x7ff0780ae410 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff07cde0700 1 -- 172.21.15.73:0/3553605169 >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 legacy=0x7ff0781d5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff07cde0700 1 -- 172.21.15.73:0/3553605169 >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 legacy=0x7ff0781d5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff07cde0700 1 --1- 172.21.15.73:0/3553605169 >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 0x7ff0781d5d00 :-1 s=OPENED pgs=132 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.310+0000 7ff07cde0700 1 --1- 172.21.15.73:0/3553605169 >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 0x7ff0781d5d00 :-1 s=OPENED pgs=132 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:21.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fc32404d160 con 0x7fc3280a8f20 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173709181 0 0) 0x7ff0781382d0 con 0x7ff078144a90 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07813fc90 con 0x7ff078144a90 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2896176030 0 0) 0x7ff05c0035d0 con 0x7ff0780a8f20 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0781382d0 con 0x7ff0780a8f20 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff070001950 con 0x7ff0780a8f20 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2361680532 0 0) 0x7ff07813fc90 con 0x7ff078144a90 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff05c0035d0 con 0x7ff078144a90 2024-09-16T14:37:21.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff074001590 con 0x7ff078144a90 2024-09-16T14:37:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbf34001230 con 0x7fbf380ae410 2024-09-16T14:37:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fbf340039d0 con 0x7fbf380ae410 2024-09-16T14:37:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fbf34003b30 con 0x7fbf380ae410 2024-09-16T14:37:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fbf3407f500 con 0x7fbf380ae410 2024-09-16T14:37:21.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.314+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fbf3407f910 con 0x7fbf380ae410 2024-09-16T14:37:21.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.318+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2671289587 0 0) 0x7ff0781382d0 con 0x7ff0780a8f20 2024-09-16T14:37:21.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 >> v1:172.21.15.73:6790/0 conn(0x7ff078144a90 legacy=0x7ff0781d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 >> v1:172.21.15.73:6789/0 conn(0x7ff0780ae410 legacy=0x7ff0781d5d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:21.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07813f0c0 con 0x7ff0780a8f20 2024-09-16T14:37:21.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff078141140 con 0x7ff0780a8f20 2024-09-16T14:37:21.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0781e17a0 con 0x7ff0780a8f20 2024-09-16T14:37:21.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff0700013e0 con 0x7ff0780a8f20 2024-09-16T14:37:21.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff070005200 con 0x7ff0780a8f20 2024-09-16T14:37:21.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7ff07001a3a0 con 0x7ff0780a8f20 2024-09-16T14:37:21.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.322+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7ff07007fa20 con 0x7ff0780a8f20 2024-09-16T14:37:21.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.326+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058005100 con 0x7ff0780a8f20 2024-09-16T14:37:21.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4ec9c700 1 Processor -- start 2024-09-16T14:37:21.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4ec9c700 1 -- start start 2024-09-16T14:37:21.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4ec9c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480abc50 con 0x7f6e481487e0 2024-09-16T14:37:21.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4ec9c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480abf30 con 0x7f6e480ae410 2024-09-16T14:37:21.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4ec9c700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480acad0 con 0x7f6e48142b90 2024-09-16T14:37:21.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4e49b700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f6e48142b90 0x7f6e48150b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52042/0 (socket says 172.21.15.73:52042) 2024-09-16T14:37:21.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.330+0000 7f6e4e49b700 1 -- 172.21.15.73:0/4056455588 learned_addr learned my addr 172.21.15.73:0/4056455588 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039714118 0 0) 0x7f6e480acad0 con 0x7f6e48142b90 2024-09-16T14:37:21.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e340035d0 con 0x7f6e48142b90 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1668473045 0 0) 0x7f6e340035d0 con 0x7f6e48142b90 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 >> v1:172.21.15.177:6789/0 conn(0x7f6e480ae410 legacy=0x7f6e480ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 >> v1:172.21.15.73:6789/0 conn(0x7f6e481487e0 legacy=0x7f6e48142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480aaf20 con 0x7f6e48142b90 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6e40001990 con 0x7f6e48142b90 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6e40001cb0 con 0x7f6e48142b90 2024-09-16T14:37:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4cc98700 1 -- 172.21.15.73:0/4056455588 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6e40002080 con 0x7f6e48142b90 2024-09-16T14:37:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4056455588 >> v1:172.21.15.73:6790/0 conn(0x7f6e48142b90 legacy=0x7f6e48150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4056455588 shutdown_connections 2024-09-16T14:37:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4056455588 >> 172.21.15.73:0/4056455588 conn(0x7f6e480af290 msgr2=0x7f6e480af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4056455588 shutdown_connections 2024-09-16T14:37:21.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4056455588 wait complete. 2024-09-16T14:37:21.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7fb152a88700 1 Processor -- start 2024-09-16T14:37:21.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.334+0000 7fb152a88700 1 -- start start 2024-09-16T14:37:21.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7ff07004d1a0 con 0x7ff0780a8f20 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 Processor -- start 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 -- start start 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb152a88700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0aa1b0 con 0x7fb14c0a8f20 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb152a88700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0a8a00 con 0x7fb14c0ae410 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb152a88700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0aecf0 con 0x7fb14c144a90 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb151285700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb14c0a8f20 0x7fb14c13e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47394/0 (socket says 172.21.15.73:47394) 2024-09-16T14:37:21.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb152287700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb14c144a90 0x7fb14c14c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52058/0 (socket says 172.21.15.73:52058) 2024-09-16T14:37:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb152287700 1 -- 172.21.15.73:0/2854534777 learned_addr learned my addr 172.21.15.73:0/2854534777 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4813ece0 con 0x7f6e481487e0 2024-09-16T14:37:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4813efc0 con 0x7f6e48142b90 2024-09-16T14:37:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4813d160 con 0x7f6e480ae410 2024-09-16T14:37:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4dc9a700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f6e480ae410 0x7f6e4813da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52066/0 (socket says 172.21.15.73:52066) 2024-09-16T14:37:21.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4dc9a700 1 -- 172.21.15.73:0/4261745168 learned_addr learned my addr 172.21.15.73:0/4261745168 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47c4d2f700 1 Processor -- start 2024-09-16T14:37:21.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb151a86700 1 -- 172.21.15.73:0/2854534777 >> v1:172.21.15.177:6789/0 conn(0x7fb14c0ae410 legacy=0x7fb14c144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2024-09-16T14:37:21.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621732812 0 0) 0x7fb14c0aecf0 con 0x7fb14c144a90 2024-09-16T14:37:21.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1380035d0 con 0x7fb14c144a90 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020977553 0 0) 0x7f6e4813d160 con 0x7f6e480ae410 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e340035d0 con 0x7f6e480ae410 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152415655 0 0) 0x7f6e4813efc0 con 0x7f6e48142b90 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e4813d160 con 0x7f6e48142b90 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 258380730 0 0) 0x7f6e340035d0 con 0x7f6e480ae410 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6e4813efc0 con 0x7f6e480ae410 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6e440018a0 con 0x7f6e480ae410 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886448543 0 0) 0x7f6e4813ece0 con 0x7f6e481487e0 2024-09-16T14:37:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e340035d0 con 0x7f6e481487e0 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2784627475 0 0) 0x7fb1380035d0 con 0x7fb14c144a90 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 >> v1:172.21.15.177:6789/0 conn(0x7fb14c0ae410 legacy=0x7fb14c144380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 >> v1:172.21.15.73:6789/0 conn(0x7fb14c0a8f20 legacy=0x7fb14c13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0aee80 con 0x7fb14c144a90 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb144001990 con 0x7fb14c144a90 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 398592240 0 0) 0x7f6e4813efc0 con 0x7f6e480ae410 2024-09-16T14:37:21.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 >> v1:172.21.15.177:6789/0 conn(0x7f6e48142b90 legacy=0x7f6e4813b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 >> v1:172.21.15.73:6789/0 conn(0x7f6e481487e0 legacy=0x7f6e480b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4813b960 con 0x7f6e480ae410 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47c4d2f700 1 -- start start 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47c4d2f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00ab760 con 0x7f47c00ae580 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47c4d2f700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c01406f0 con 0x7f47c0140260 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47c4d2f700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c00ab9d0 con 0x7f47c01465f0 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47be59c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47c00ae580 0x7f47c013d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47408/0 (socket says 172.21.15.73:47408) 2024-09-16T14:37:21.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f47be59c700 1 -- 172.21.15.73:0/338337776 learned_addr learned my addr 172.21.15.73:0/338337776 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb144001bb0 con 0x7fb14c144a90 2024-09-16T14:37:21.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb150a84700 1 -- 172.21.15.73:0/2854534777 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb144001f80 con 0x7fb14c144a90 2024-09-16T14:37:21.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4813bbb0 con 0x7f6e480ae410 2024-09-16T14:37:21.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4813ce20 con 0x7f6e480ae410 2024-09-16T14:37:21.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb152a88700 1 -- 172.21.15.73:0/2854534777 >> v1:172.21.15.73:6790/0 conn(0x7fb14c144a90 legacy=0x7fb14c14c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6e440036c0 con 0x7f6e480ae410 2024-09-16T14:37:21.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb152a88700 1 -- 172.21.15.73:0/2854534777 shutdown_connections 2024-09-16T14:37:21.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb152a88700 1 -- 172.21.15.73:0/2854534777 >> 172.21.15.73:0/2854534777 conn(0x7fb14c0af290 msgr2=0x7fb14c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6e440039d0 con 0x7f6e480ae410 2024-09-16T14:37:21.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.338+0000 7fb151a86700 1 --1- 172.21.15.73:0/2854534777 >> v1:172.21.15.177:6789/0 conn(0x7fb14c0ae410 0x7fb14c144380 :-1 s=OPENED pgs=123 cs=1 l=1).write_message error sending 0x7fb14c0a8a00, (32) Broken pipe 2024-09-16T14:37:21.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb151a86700 1 --1- 172.21.15.73:0/2854534777 >> v1:172.21.15.177:6789/0 conn(0x7fb14c0ae410 0x7fb14c144380 :-1 s=CLOSED pgs=123 cs=1 l=1).write_event send msg failed 2024-09-16T14:37:21.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb151a86700 1 --1- 172.21.15.73:0/2854534777 >> v1:172.21.15.177:6789/0 conn(0x7fb14c0ae410 0x7fb14c144380 :-1 s=CLOSED pgs=123 cs=1 l=1).write_event send msg failed 2024-09-16T14:37:21.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f6e44003b30 con 0x7f6e480ae410 2024-09-16T14:37:21.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb152a88700 1 -- 172.21.15.73:0/2854534777 shutdown_connections 2024-09-16T14:37:21.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb152a88700 1 -- 172.21.15.73:0/2854534777 wait complete. 2024-09-16T14:37:21.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e30005100 con 0x7f6e480ae410 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583145261 0 0) 0x7f47c00ab760 con 0x7f47c00ae580 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a80035d0 con 0x7f47c00ae580 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553252714 0 0) 0x7f47c01406f0 con 0x7f47c0140260 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c00ab760 con 0x7f47c0140260 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956422247 0 0) 0x7f47c00ab9d0 con 0x7f47c01465f0 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c01406f0 con 0x7f47c01465f0 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2824353267 0 0) 0x7f47a80035d0 con 0x7f47c00ae580 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 >> v1:172.21.15.73:6790/0 conn(0x7f47c01465f0 legacy=0x7f47c01489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 >> v1:172.21.15.177:6789/0 conn(0x7f47c0140260 legacy=0x7f47c01409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c013d0b0 con 0x7f47c00ae580 2024-09-16T14:37:21.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7fb152a88700 1 Processor -- start 2024-09-16T14:37:21.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.342+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f47b0001540 con 0x7f47c00ae580 2024-09-16T14:37:21.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f47b00017d0 con 0x7f47c00ae580 2024-09-16T14:37:21.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7f47bd59a700 1 -- 172.21.15.73:0/338337776 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f47b0001ae0 con 0x7f47c00ae580 2024-09-16T14:37:21.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7fb152a88700 1 -- start start 2024-09-16T14:37:21.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7fb152a88700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c138760 con 0x7fb14c144a90 2024-09-16T14:37:21.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7fb152a88700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c1389d0 con 0x7fb14c1431c0 2024-09-16T14:37:21.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7fb152a88700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c138cb0 con 0x7fb14c0a8f20 2024-09-16T14:37:21.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7f47c4d2f700 1 -- 172.21.15.73:0/338337776 >> v1:172.21.15.73:6789/0 conn(0x7f47c00ae580 legacy=0x7f47c013d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7f47c4d2f700 1 -- 172.21.15.73:0/338337776 shutdown_connections 2024-09-16T14:37:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7f47c4d2f700 1 -- 172.21.15.73:0/338337776 >> 172.21.15.73:0/338337776 conn(0x7f47c006a360 msgr2=0x7f47c006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7fb151285700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb14c144a90 0x7fb14c1de060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47418/0 (socket says 172.21.15.73:47418) 2024-09-16T14:37:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.346+0000 7fb151285700 1 -- 172.21.15.73:0/3490082611 learned_addr learned my addr 172.21.15.73:0/3490082611 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f6e4407f4f0 con 0x7f6e480ae410 2024-09-16T14:37:21.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f6e440818e0 con 0x7f6e480ae410 2024-09-16T14:37:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 -- 172.21.15.73:0/338337776 shutdown_connections 2024-09-16T14:37:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 -- 172.21.15.73:0/338337776 wait complete. 2024-09-16T14:37:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 Processor -- start 2024-09-16T14:37:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 -- start start 2024-09-16T14:37:21.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c0144aa0 con 0x7f47c01465f0 2024-09-16T14:37:21.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c0072050 con 0x7f47c0140260 2024-09-16T14:37:21.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47c4d2f700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c0143570 con 0x7f47c0143930 2024-09-16T14:37:21.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47bed9d700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f47c0143930 0x7f47c01dd4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52098/0 (socket says 172.21.15.73:52098) 2024-09-16T14:37:21.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47bdd9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47c01465f0 0x7f47c0070ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47426/0 (socket says 172.21.15.73:47426) 2024-09-16T14:37:21.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.350+0000 7f47bed9d700 1 -- 172.21.15.73:0/1051463097 learned_addr learned my addr 172.21.15.73:0/1051463097 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136722879 0 0) 0x7f47c0144aa0 con 0x7f47c01465f0 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824350147 0 0) 0x7fb14c138760 con 0x7fb14c144a90 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1300035d0 con 0x7fb14c144a90 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100392620 0 0) 0x7fb14c1389d0 con 0x7fb14c1431c0 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb14c138760 con 0x7fb14c1431c0 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224566788 0 0) 0x7fb14c138cb0 con 0x7fb14c0a8f20 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb14c1389d0 con 0x7fb14c0a8f20 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a00035d0 con 0x7f47c01465f0 2024-09-16T14:37:21.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674776513 0 0) 0x7f47c0143570 con 0x7f47c0143930 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c0144aa0 con 0x7f47c0143930 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806870664 0 0) 0x7f47c0072050 con 0x7f47c0140260 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c0143570 con 0x7f47c0140260 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2528395916 0 0) 0x7f47a00035d0 con 0x7f47c01465f0 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f47c0072050 con 0x7f47c01465f0 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f47b4001880 con 0x7f47c01465f0 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 380481185 0 0) 0x7fb14c1389d0 con 0x7fb14c0a8f20 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb14c138cb0 con 0x7fb14c0a8f20 2024-09-16T14:37:21.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1984605989 0 0) 0x7fb14c138760 con 0x7fb14c1431c0 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb14c1389d0 con 0x7fb14c1431c0 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb148001a00 con 0x7fb14c0a8f20 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1889208591 0 0) 0x7fb1300035d0 con 0x7fb14c144a90 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb14c138760 con 0x7fb14c144a90 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb144001ec0 con 0x7fb14c1431c0 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb13c0017c0 con 0x7fb14c144a90 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 547373817 0 0) 0x7f47c0144aa0 con 0x7f47c0143930 2024-09-16T14:37:21.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f47a00035d0 con 0x7f47c0143930 2024-09-16T14:37:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3217361964 0 0) 0x7fb14c1389d0 con 0x7fb14c1431c0 2024-09-16T14:37:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 >> v1:172.21.15.73:6790/0 conn(0x7fb14c0a8f20 legacy=0x7fb14c1dd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 >> v1:172.21.15.73:6789/0 conn(0x7fb14c144a90 legacy=0x7fb14c1de060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c143d70 con 0x7fb14c1431c0 2024-09-16T14:37:21.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c1cca80 con 0x7fb14c1431c0 2024-09-16T14:37:21.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c1cc850 con 0x7fb14c1431c0 2024-09-16T14:37:21.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb1440020e0 con 0x7fb14c1431c0 2024-09-16T14:37:21.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb144004ec0 con 0x7fb14c1431c0 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 695244357 0 0) 0x7f47c0143570 con 0x7f47c0140260 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f47c0144aa0 con 0x7f47c0140260 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2901893654 0 0) 0x7f47c0072050 con 0x7f47c01465f0 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6790/0 conn(0x7f47c0143930 legacy=0x7f47c01dd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.177:6789/0 conn(0x7f47c0140260 legacy=0x7f47c0144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c0143700 con 0x7f47c01465f0 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c013fc20 con 0x7f47c01465f0 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c01d1c80 con 0x7f47c01465f0 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47bdd9b700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6789/0 conn(0x7f47c01465f0 legacy=0x7f47c0070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-16T14:37:21.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47bdd9b700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6789/0 conn(0x7f47c01465f0 legacy=0x7f47c0070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:21.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47bdd9b700 1 --1- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6789/0 conn(0x7f47c01465f0 0x7f47c0070ea0 :-1 s=OPENED pgs=139 cs=1 l=1).handle_message read tag failed 2024-09-16T14:37:21.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47bdd9b700 1 --1- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6789/0 conn(0x7f47c01465f0 0x7f47c0070ea0 :-1 s=OPENED pgs=139 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:37:21.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d37e3700 1 Processor -- start 2024-09-16T14:37:21.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d37e3700 1 -- start start 2024-09-16T14:37:21.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d37e3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc0ad020 con 0x7f62cc0ac610 2024-09-16T14:37:21.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6789/0 conn(0x7f47c01465f0 legacy=0x7f47c0070ea0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:21.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d37e3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc142d00 con 0x7f62cc0abd40 2024-09-16T14:37:21.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d37e3700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc0ac120 con 0x7f62cc14e960 2024-09-16T14:37:21.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d157f700 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f62cc0abd40 0x7f62cc1425f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.73:50258/0 (socket says 172.21.15.73:50258) 2024-09-16T14:37:21.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f47c0072050 con 0x7f47a000c8e0 2024-09-16T14:37:21.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.358+0000 7f62d157f700 1 -- 172.21.15.73:0/2469328378 learned_addr learned my addr 172.21.15.73:0/2469328378 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f47a00035d0 con 0x7f47c0140260 2024-09-16T14:37:21.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f47c0143570 con 0x7f47c0143930 2024-09-16T14:37:21.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001741095 0 0) 0x7f47c0072050 con 0x7f47a000c8e0 2024-09-16T14:37:21.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f47a0011b60 con 0x7f47a000c8e0 2024-09-16T14:37:21.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39651398 0 0) 0x7f47a00035d0 con 0x7f47c0140260 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.177:6789/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f47c0072050 con 0x7f47c0140260 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520001238 0 0) 0x7f47c0143570 con 0x7f47c0143930 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6790/0 -- auth(proto 2 132 bytes epoch 0) v1 -- 0x7f47a00035d0 con 0x7f47c0143930 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 233+0+0 (unknown 392801745 0 0) 0x7f47a0011b60 con 0x7f47a000c8e0 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6790/0 conn(0x7f47c0143930 legacy=0x7f47a000b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.177:6789/0 conn(0x7f47c0140260 legacy=0x7f47a0007a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7f47a0011850 con 0x7f47a000c8e0 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f47b8003be0 con 0x7f47a000c8e0 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fb14401a060 con 0x7fb14c1431c0 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fb14407f7a0 con 0x7fb14c1431c0 2024-09-16T14:37:21.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb134005100 con 0x7fb14c1431c0 2024-09-16T14:37:21.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805929617 0 0) 0x7f62cc0ad020 con 0x7f62cc0ac610 2024-09-16T14:37:21.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b80035d0 con 0x7f62cc0ac610 2024-09-16T14:37:21.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041524913 0 0) 0x7f62cc0ac120 con 0x7f62cc14e960 2024-09-16T14:37:21.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62cc0ad020 con 0x7f62cc14e960 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 988779175 0 0) 0x7f62cc0ad020 con 0x7f62cc14e960 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 >> v1:172.21.15.177:6789/0 conn(0x7f62cc0abd40 legacy=0x7f62cc1425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 >> v1:172.21.15.73:6789/0 conn(0x7f62cc0ac610 legacy=0x7f62cc0ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc0aaff0 con 0x7f62cc14e960 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f62c4001840 con 0x7f62cc14e960 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f47b8003e70 con 0x7f47a000c8e0 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f47b8004060 con 0x7f47a000c8e0 2024-09-16T14:37:21.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f62c4001a70 con 0x7f62cc14e960 2024-09-16T14:37:21.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62c3fff700 1 -- 172.21.15.73:0/2469328378 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f62c4001e00 con 0x7f62cc14e960 2024-09-16T14:37:21.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62d37e3700 1 -- 172.21.15.73:0/2469328378 >> v1:172.21.15.73:6790/0 conn(0x7f62cc14e960 legacy=0x7f62cc150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 6 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f47b807f9d0 con 0x7f47a000c8e0 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62d37e3700 1 -- 172.21.15.73:0/2469328378 shutdown_connections 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62d37e3700 1 -- 172.21.15.73:0/2469328378 >> 172.21.15.73:0/2469328378 conn(0x7f62cc06a360 msgr2=0x7f62cc06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62d37e3700 1 -- 172.21.15.73:0/2469328378 shutdown_connections 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.362+0000 7f62d37e3700 1 -- 172.21.15.73:0/2469328378 wait complete. 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d37e3700 1 Processor -- start 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d37e3700 1 -- start start 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d37e3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc14c780 con 0x7f62cc14e960 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d37e3700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc14c1f0 con 0x7f62cc0ac610 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d37e3700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc14b220 con 0x7f62cc0abd40 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d1d80700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f62cc14e960 0x7f62cc1e4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47446/0 (socket says 172.21.15.73:47446) 2024-09-16T14:37:21.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d1d80700 1 -- 172.21.15.73:0/3000491724 learned_addr learned my addr 172.21.15.73:0/3000491724 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f62d157f700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f62cc0abd40 0x7f62cc1dd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52120/0 (socket says 172.21.15.73:52120) 2024-09-16T14:37:21.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.366+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a4005100 con 0x7f47a000c8e0 2024-09-16T14:37:21.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.370+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f47b804d210 con 0x7f47a000c8e0 2024-09-16T14:37:21.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.370+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fb14404cf20 con 0x7fb14c1431c0 2024-09-16T14:37:21.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217571225 0 0) 0x7f62cc14b220 con 0x7f62cc0abd40 2024-09-16T14:37:21.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b00035d0 con 0x7f62cc0abd40 2024-09-16T14:37:21.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992568646 0 0) 0x7f62cc14c1f0 con 0x7f62cc0ac610 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62cc14b220 con 0x7f62cc0ac610 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019675394 0 0) 0x7f62cc14c780 con 0x7f62cc14e960 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62cc14c1f0 con 0x7f62cc14e960 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1930037488 0 0) 0x7f62cc14b220 con 0x7f62cc0ac610 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62cc14c780 con 0x7f62cc0ac610 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1821192141 0 0) 0x7f62cc14c1f0 con 0x7f62cc14e960 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62cc14b220 con 0x7f62cc14e960 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f62bc001850 con 0x7f62cc0ac610 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f62c4001e00 con 0x7f62cc14e960 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 525304510 0 0) 0x7f62cc14c780 con 0x7f62cc0ac610 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 >> v1:172.21.15.73:6790/0 conn(0x7f62cc0abd40 legacy=0x7f62cc1dd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 >> v1:172.21.15.73:6789/0 conn(0x7f62cc14e960 legacy=0x7f62cc1e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc148850 con 0x7f62cc0ac610 2024-09-16T14:37:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc148b00 con 0x7f62cc0ac610 2024-09-16T14:37:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc14bc70 con 0x7f62cc0ac610 2024-09-16T14:37:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f62bc001d20 con 0x7f62cc0ac610 2024-09-16T14:37:21.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.378+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f62bc003860 con 0x7f62cc0ac610 2024-09-16T14:37:21.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.386+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f62bc018a00 con 0x7f62cc0ac610 2024-09-16T14:37:21.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.386+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f62bc07e180 con 0x7f62cc0ac610 2024-09-16T14:37:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.390+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac005100 con 0x7f62cc0ac610 2024-09-16T14:37:21.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.398+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f62bc04b730 con 0x7f62cc0ac610 2024-09-16T14:37:21.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.606+0000 7f0b4ab84700 1 -- 172.21.15.73:0/3862419342 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0b2c0053b0 con 0x7f0b3c0343d0 2024-09-16T14:37:21.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.606+0000 7f0b3a7fc700 1 -- 172.21.15.73:0/3862419342 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 3887400221) 0x7f0b440c7650 con 0x7f0b3c0343d0 2024-09-16T14:37:21.612 INFO:teuthology.orchestra.run.smithi073.stdout:60129542148 2024-09-16T14:37:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.610+0000 7f0b27fff700 1 -- 172.21.15.73:0/3862419342 >> v1:172.21.15.177:6816/2823028339 conn(0x7f0b30067700 legacy=0x7f0b30069bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.610+0000 7f0b27fff700 1 -- 172.21.15.73:0/3862419342 >> v1:172.21.15.177:6789/0 conn(0x7f0b3c0343d0 legacy=0x7f0b3c02ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.610+0000 7f0b27fff700 1 -- 172.21.15.73:0/3862419342 shutdown_connections 2024-09-16T14:37:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.610+0000 7f0b27fff700 1 -- 172.21.15.73:0/3862419342 >> 172.21.15.73:0/3862419342 conn(0x7f0b3c005510 msgr2=0x7f0b3c02f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.610+0000 7f0b27fff700 1 -- 172.21.15.73:0/3862419342 shutdown_connections 2024-09-16T14:37:21.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.610+0000 7f0b27fff700 1 -- 172.21.15.73:0/3862419342 wait complete. 2024-09-16T14:37:21.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-09-16T14:37:21.627 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.630+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf38144e30 con 0x7fbf380ae410 2024-09-16T14:37:21.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.630+0000 7fbf2e7fc700 1 -- 172.21.15.73:0/3451561799 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 4095188330) 0x7fbf3407f020 con 0x7fbf380ae410 2024-09-16T14:37:21.633 INFO:teuthology.orchestra.run.smithi073.stdout:60129542149 2024-09-16T14:37:21.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.630+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc3100053b0 con 0x7fc3280a8f20 2024-09-16T14:37:21.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.630+0000 7fc31effd700 1 -- 172.21.15.73:0/1442435571 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 2194451396) 0x7fc32404f090 con 0x7fc3280a8f20 2024-09-16T14:37:21.634 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 >> v1:172.21.15.177:6816/2823028339 conn(0x7fc30c067510 legacy=0x7fc30c0699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 >> v1:172.21.15.73:6790/0 conn(0x7fc3280a8f20 legacy=0x7fc3281d5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 shutdown_connections 2024-09-16T14:37:21.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 >> 172.21.15.73:0/1442435571 conn(0x7fc3280af290 msgr2=0x7fc3280b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 shutdown_connections 2024-09-16T14:37:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fc32f0d1700 1 -- 172.21.15.73:0/1442435571 wait complete. 2024-09-16T14:37:21.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 >> v1:172.21.15.177:6816/2823028339 conn(0x7fbf1c067030 legacy=0x7fbf1c0694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 >> v1:172.21.15.73:6789/0 conn(0x7fbf380ae410 legacy=0x7fbf38144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 shutdown_connections 2024-09-16T14:37:21.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 >> 172.21.15.73:0/3451561799 conn(0x7fbf380af290 msgr2=0x7fbf38148c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 shutdown_connections 2024-09-16T14:37:21.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.634+0000 7fbf3eefb700 1 -- 172.21.15.73:0/3451561799 wait complete. 2024-09-16T14:37:21.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2024-09-16T14:37:21.648 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-16T14:37:21.653 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff0580053b0 con 0x7ff0780a8f20 2024-09-16T14:37:21.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff06dffb700 1 -- 172.21.15.73:0/3553605169 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (unknown 1482059429 0 2194451396) 0x7ff07004f0d0 con 0x7ff0780a8f20 2024-09-16T14:37:21.657 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:21.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6e300053b0 con 0x7f6e480ae410 2024-09-16T14:37:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 >> v1:172.21.15.177:6816/2823028339 conn(0x7ff05c067450 legacy=0x7ff05c069910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 >> v1:172.21.15.177:6789/0 conn(0x7ff0780a8f20 legacy=0x7ff078140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 shutdown_connections 2024-09-16T14:37:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 >> 172.21.15.73:0/3553605169 conn(0x7ff0780af290 msgr2=0x7ff0780aa640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7f6e3e7fc700 1 -- 172.21.15.73:0/4261745168 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (unknown 2131975755 0 2194451396) 0x7f6e4404caa0 con 0x7f6e480ae410 2024-09-16T14:37:21.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 shutdown_connections 2024-09-16T14:37:21.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.654+0000 7ff07e5e3700 1 -- 172.21.15.73:0/3553605169 wait complete. 2024-09-16T14:37:21.662 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.658+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 >> v1:172.21.15.177:6816/2823028339 conn(0x7f6e34067470 legacy=0x7f6e34069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.658+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 >> v1:172.21.15.73:6790/0 conn(0x7f6e480ae410 legacy=0x7f6e4813da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.658+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 shutdown_connections 2024-09-16T14:37:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.658+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 >> 172.21.15.73:0/4261745168 conn(0x7f6e480af290 msgr2=0x7f6e48148c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.658+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 shutdown_connections 2024-09-16T14:37:21.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.658+0000 7f6e4ec9c700 1 -- 172.21.15.73:0/4261745168 wait complete. 2024-09-16T14:37:21.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.666+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f47a40053b0 con 0x7f47a000c8e0 2024-09-16T14:37:21.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.666+0000 7f47aeffd700 1 -- 172.21.15.73:0/1051463097 <== mon.0 v1:172.21.15.73:6789/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (unknown 1274345170 0 3887400221) 0x7f47b804f140 con 0x7f47a000c8e0 2024-09-16T14:37:21.670 INFO:teuthology.orchestra.run.smithi073.stdout:60129542148 2024-09-16T14:37:21.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2024-09-16T14:37:21.672 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.670+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.177:6816/2823028339 conn(0x7f47c01465f0 legacy=0x7f47a0074e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.670+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 >> v1:172.21.15.73:6789/0 conn(0x7f47a000c8e0 legacy=0x7f47a000ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.670+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 shutdown_connections 2024-09-16T14:37:21.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.670+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 >> 172.21.15.73:0/1051463097 conn(0x7f47c006a360 msgr2=0x7f47c00a8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.670+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 shutdown_connections 2024-09-16T14:37:21.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.670+0000 7f47c4d2f700 1 -- 172.21.15.73:0/1051463097 wait complete. 2024-09-16T14:37:21.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.5 2024-09-16T14:37:21.677 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.678+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1340053b0 con 0x7fb14c1431c0 2024-09-16T14:37:21.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.678+0000 7fb1427fc700 1 -- 172.21.15.73:0/3490082611 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 3887400221) 0x7fb14404ee50 con 0x7fb14c1431c0 2024-09-16T14:37:21.683 INFO:teuthology.orchestra.run.smithi073.stdout:60129542148 2024-09-16T14:37:21.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.682+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 >> v1:172.21.15.177:6816/2823028339 conn(0x7fb130067730 legacy=0x7fb130069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.682+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 >> v1:172.21.15.177:6789/0 conn(0x7fb14c1431c0 legacy=0x7fb14c1e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.682+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 shutdown_connections 2024-09-16T14:37:21.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.682+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 >> 172.21.15.73:0/3490082611 conn(0x7fb14c0af290 msgr2=0x7fb14c13e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.682+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 shutdown_connections 2024-09-16T14:37:21.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.682+0000 7fb152a88700 1 -- 172.21.15.73:0/3490082611 wait complete. 2024-09-16T14:37:21.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-09-16T14:37:21.687 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2024-09-16T14:37:21.696 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.698+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 --> v1:172.21.15.177:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f62ac0053b0 con 0x7f62cc0ac610 2024-09-16T14:37:21.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.698+0000 7f62c1ffb700 1 -- 172.21.15.73:0/3000491724 <== mon.1 v1:172.21.15.177:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (unknown 1823589948 0 2194451396) 0x7f62bc04d830 con 0x7f62cc0ac610 2024-09-16T14:37:21.703 INFO:teuthology.orchestra.run.smithi073.stdout:55834574851 2024-09-16T14:37:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.702+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 >> v1:172.21.15.177:6816/2823028339 conn(0x7f62b0067690 legacy=0x7f62b0069b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.702+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 >> v1:172.21.15.177:6789/0 conn(0x7f62cc0ac610 legacy=0x7f62cc1de0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.702+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 shutdown_connections 2024-09-16T14:37:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.702+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 >> 172.21.15.73:0/3000491724 conn(0x7f62cc06a360 msgr2=0x7f62cc0b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.702+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 shutdown_connections 2024-09-16T14:37:21.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.702+0000 7f62d37e3700 1 -- 172.21.15.73:0/3000491724 wait complete. 2024-09-16T14:37:21.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2024-09-16T14:37:21.715 DEBUG:teuthology.parallel:result is None 2024-09-16T14:37:21.715 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T14:37:21.716 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:37:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 Processor -- start 2024-09-16T14:37:21.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- start start 2024-09-16T14:37:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69402dd50 con 0x7fa6940c2a90 2024-09-16T14:37:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69402dfa0 con 0x7fa6940064b0 2024-09-16T14:37:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69402c3c0 con 0x7fa69402c8e0 2024-09-16T14:37:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69bfff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fa69402c8e0 0x7fa6940c2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52124/0 (socket says 172.21.15.73:52124) 2024-09-16T14:37:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a11c7700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa6940c2a90 0x7fa6940d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47454/0 (socket says 172.21.15.73:47454) 2024-09-16T14:37:21.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69bfff700 1 -- 172.21.15.73:0/1817467802 learned_addr learned my addr 172.21.15.73:0/1817467802 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093000840 0 0) 0x7fa69402c3c0 con 0x7fa69402c8e0 2024-09-16T14:37:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa68c0035d0 con 0x7fa69402c8e0 2024-09-16T14:37:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368218823 0 0) 0x7fa69402dd50 con 0x7fa6940c2a90 2024-09-16T14:37:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa69402c3c0 con 0x7fa6940c2a90 2024-09-16T14:37:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3282006070 0 0) 0x7fa68c0035d0 con 0x7fa69402c8e0 2024-09-16T14:37:21.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 >> v1:172.21.15.177:6789/0 conn(0x7fa6940064b0 legacy=0x7fa69402e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 >> v1:172.21.15.73:6789/0 conn(0x7fa6940c2a90 legacy=0x7fa6940d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69400b450 con 0x7fa69402c8e0 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa688001610 con 0x7fa69402c8e0 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa688001900 con 0x7fa69402c8e0 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa69b7fe700 1 -- 172.21.15.73:0/1817467802 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa688001d10 con 0x7fa69402c8e0 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- 172.21.15.73:0/1817467802 >> v1:172.21.15.73:6790/0 conn(0x7fa69402c8e0 legacy=0x7fa6940c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- 172.21.15.73:0/1817467802 shutdown_connections 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- 172.21.15.73:0/1817467802 >> 172.21.15.73:0/1817467802 conn(0x7fa694005510 msgr2=0x7fa694005920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- 172.21.15.73:0/1817467802 shutdown_connections 2024-09-16T14:37:21.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.862+0000 7fa6a19c8700 1 -- 172.21.15.73:0/1817467802 wait complete. 2024-09-16T14:37:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 Processor -- start 2024-09-16T14:37:21.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 -- start start 2024-09-16T14:37:21.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa694032030 con 0x7fa6940064b0 2024-09-16T14:37:21.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940b9710 con 0x7fa6940c2a90 2024-09-16T14:37:21.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6940bad50 con 0x7fa69402c8e0 2024-09-16T14:37:21.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a09c6700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa6940064b0 0x7fa6940ba640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47466/0 (socket says 172.21.15.73:47466) 2024-09-16T14:37:21.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa69bfff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fa69402c8e0 0x7fa69415f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52136/0 (socket says 172.21.15.73:52136) 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a09c6700 1 -- 172.21.15.73:0/3383740424 learned_addr learned my addr 172.21.15.73:0/3383740424 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006799265 0 0) 0x7fa6940bad50 con 0x7fa69402c8e0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6800035d0 con 0x7fa69402c8e0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392640404 0 0) 0x7fa694032030 con 0x7fa6940064b0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6940bad50 con 0x7fa6940064b0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675636438 0 0) 0x7fa6940b9710 con 0x7fa6940c2a90 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa694032030 con 0x7fa6940c2a90 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1866122301 0 0) 0x7fa6800035d0 con 0x7fa69402c8e0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6940b9710 con 0x7fa69402c8e0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa688001430 con 0x7fa69402c8e0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1949651444 0 0) 0x7fa6940bad50 con 0x7fa6940064b0 2024-09-16T14:37:21.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6800035d0 con 0x7fa6940064b0 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa690001970 con 0x7fa6940064b0 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2284354867 0 0) 0x7fa694032030 con 0x7fa6940c2a90 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6940bad50 con 0x7fa6940c2a90 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2209275769 0 0) 0x7fa6940b9710 con 0x7fa69402c8e0 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 >> v1:172.21.15.177:6789/0 conn(0x7fa6940c2a90 legacy=0x7fa69415fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 >> v1:172.21.15.73:6789/0 conn(0x7fa6940064b0 legacy=0x7fa6940ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6941605d0 con 0x7fa69402c8e0 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6940b9980 con 0x7fa69402c8e0 2024-09-16T14:37:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.866+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa694034a60 con 0x7fa69402c8e0 2024-09-16T14:37:21.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.870+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa688004d20 con 0x7fa69402c8e0 2024-09-16T14:37:21.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.870+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa688005030 con 0x7fa69402c8e0 2024-09-16T14:37:21.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.870+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c005100 con 0x7fa69402c8e0 2024-09-16T14:37:21.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.870+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fa68801a1d0 con 0x7fa69402c8e0 2024-09-16T14:37:21.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.870+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fa68807f6f0 con 0x7fa69402c8e0 2024-09-16T14:37:21.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:21.878+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fa68804ce00 con 0x7fa69402c8e0 2024-09-16T14:37:22.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.026+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa67c000b90 con 0x7fa680067430 2024-09-16T14:37:22.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.030+0000 7fa6997fa700 1 -- 172.21.15.73:0/3383740424 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48604 (unknown 2965378022 0 108928014) 0x7fa67c000b90 con 0x7fa680067430 2024-09-16T14:37:22.037 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.034+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 >> v1:172.21.15.177:6816/2823028339 conn(0x7fa680067430 legacy=0x7fa6800698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.034+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 >> v1:172.21.15.73:6790/0 conn(0x7fa69402c8e0 legacy=0x7fa69415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.034+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 shutdown_connections 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.034+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 >> 172.21.15.73:0/3383740424 conn(0x7fa694005510 msgr2=0x7fa6940be1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.034+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 shutdown_connections 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.034+0000 7fa6a19c8700 1 -- 172.21.15.73:0/3383740424 wait complete. 2024-09-16T14:37:22.041 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:37:22.051 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-09-16T14:37:21.146040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225836,"kb_used_data":1436,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754748884,"statfs":{"total":773094113280,"available":772862857216,"internally_reserved":0,"allocated":1470464,"data_stored":1496274,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":12744,"internal_metadata":229625400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":590387,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.844744"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.311977+0000","last_change":"2024-09-16T14:37:18.312221+0000","last_active":"2024-09-16T14:37:18.311977+0000","last_peered":"2024-09-16T14:37:18.311977+0000","last_clean":"2024-09-16T14:37:18.311977+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:37:18.311977+0000","last_undegraded":"2024-09-16T14:37:18.311977+0000","last_fullsized":"2024-09-16T14:37:18.311977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:52.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.305432+0000","last_change":"2024-09-16T14:37:18.305901+0000","last_active":"2024-09-16T14:37:18.305432+0000","last_peered":"2024-09-16T14:37:18.305432+0000","last_clean":"2024-09-16T14:37:18.305432+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:37:18.305432+0000","last_undegraded":"2024-09-16T14:37:18.305432+0000","last_fullsized":"2024-09-16T14:37:18.305432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:15:04.908893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.311489+0000","last_change":"2024-09-16T14:37:18.311955+0000","last_active":"2024-09-16T14:37:18.311489+0000","last_peered":"2024-09-16T14:37:18.311489+0000","last_clean":"2024-09-16T14:37:18.311489+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:37:18.311489+0000","last_undegraded":"2024-09-16T14:37:18.311489+0000","last_fullsized":"2024-09-16T14:37:18.311489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:15.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.444725+0000","last_change":"2024-09-16T14:37:18.445088+0000","last_active":"2024-09-16T14:37:18.444725+0000","last_peered":"2024-09-16T14:37:18.444725+0000","last_clean":"2024-09-16T14:37:18.444725+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:37:18.444725+0000","last_undegraded":"2024-09-16T14:37:18.444725+0000","last_fullsized":"2024-09-16T14:37:18.444725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:26:02.071763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.311825+0000","last_change":"2024-09-16T14:37:18.311825+0000","last_active":"2024-09-16T14:37:18.311825+0000","last_peered":"2024-09-16T14:37:18.311825+0000","last_clean":"2024-09-16T14:37:18.311825+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:37:18.311825+0000","last_undegraded":"2024-09-16T14:37:18.311825+0000","last_fullsized":"2024-09-16T14:37:18.311825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:34.098272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.445545+0000","last_change":"2024-09-16T14:37:18.446072+0000","last_active":"2024-09-16T14:37:18.445545+0000","last_peered":"2024-09-16T14:37:18.445545+0000","last_clean":"2024-09-16T14:37:18.445545+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:37:18.445545+0000","last_undegraded":"2024-09-16T14:37:18.445545+0000","last_fullsized":"2024-09-16T14:37:18.445545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:00:52.557322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.310544+0000","last_change":"2024-09-16T14:37:18.310876+0000","last_active":"2024-09-16T14:37:18.310544+0000","last_peered":"2024-09-16T14:37:18.310544+0000","last_clean":"2024-09-16T14:37:18.310544+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:37:18.310544+0000","last_undegraded":"2024-09-16T14:37:18.310544+0000","last_fullsized":"2024-09-16T14:37:18.310544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:54.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.312049+0000","last_change":"2024-09-16T14:37:18.312343+0000","last_active":"2024-09-16T14:37:18.312049+0000","last_peered":"2024-09-16T14:37:18.312049+0000","last_clean":"2024-09-16T14:37:18.312049+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:37:18.312049+0000","last_undegraded":"2024-09-16T14:37:18.312049+0000","last_fullsized":"2024-09-16T14:37:18.312049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:47:21.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T14:37:17.300710+0000","last_change":"2024-09-16T14:37:15.105418+0000","last_active":"2024-09-16T14:37:17.300710+0000","last_peered":"2024-09-16T14:37:17.300710+0000","last_clean":"2024-09-16T14:37:17.300710+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:37:17.300710+0000","last_undegraded":"2024-09-16T14:37:17.300710+0000","last_fullsized":"2024-09-16T14:37:17.300710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_clean_scrub_stamp":"2024-09-16T14:37:13.233269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:11.758633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":167936,"data_stored":53980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":583845,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":229376,"data_stored":583845,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":54936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:37:22.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:37:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 Processor -- start 2024-09-16T14:37:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- start start 2024-09-16T14:37:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec0aa5d0 con 0x7ff1ec142ce0 2024-09-16T14:37:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06ae50 con 0x7ff1ec0ae580 2024-09-16T14:37:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec0aef80 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1eb59e700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7ff1ec0a9a70 0x7ff1ec150bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52144/0 (socket says 172.21.15.73:52144) 2024-09-16T14:37:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1eb59e700 1 -- 172.21.15.73:0/1319573445 learned_addr learned my addr 172.21.15.73:0/1319573445 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419792052 0 0) 0x7ff1ec0aef80 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d40035d0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097495219 0 0) 0x7ff1ec0aa5d0 con 0x7ff1ec142ce0 2024-09-16T14:37:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ec0aef80 con 0x7ff1ec142ce0 2024-09-16T14:37:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559931483 0 0) 0x7ff1ec06ae50 con 0x7ff1ec0ae580 2024-09-16T14:37:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ec0aa5d0 con 0x7ff1ec0ae580 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3747476087 0 0) 0x7ff1d40035d0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 >> v1:172.21.15.177:6789/0 conn(0x7ff1ec0ae580 legacy=0x7ff1ec1425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 >> v1:172.21.15.73:6789/0 conn(0x7ff1ec142ce0 legacy=0x7ff1ec145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec0af110 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff1e4001990 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff1e4001c70 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1e9d9b700 1 -- 172.21.15.73:0/1319573445 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff1e4002040 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- 172.21.15.73:0/1319573445 >> v1:172.21.15.73:6790/0 conn(0x7ff1ec0a9a70 legacy=0x7ff1ec150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- 172.21.15.73:0/1319573445 shutdown_connections 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- 172.21.15.73:0/1319573445 >> 172.21.15.73:0/1319573445 conn(0x7ff1ec06a360 msgr2=0x7ff1ec06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- 172.21.15.73:0/1319573445 shutdown_connections 2024-09-16T14:37:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.150+0000 7ff1f1249700 1 -- 172.21.15.73:0/1319573445 wait complete. 2024-09-16T14:37:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 Processor -- start 2024-09-16T14:37:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 -- start start 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec1487e0 con 0x7ff1ec142ce0 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec13fcd0 con 0x7ff1ec0ae580 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec06df50 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1ead9d700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7ff1ec0a9a70 0x7ff1ec148cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52158/0 (socket says 172.21.15.73:52158) 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1ead9d700 1 -- 172.21.15.73:0/529066465 learned_addr learned my addr 172.21.15.73:0/529066465 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017614177 0 0) 0x7ff1ec06df50 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d80035d0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197639278 0 0) 0x7ff1ec1487e0 con 0x7ff1ec142ce0 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ec06df50 con 0x7ff1ec142ce0 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 388978094 0 0) 0x7ff1d80035d0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1ec1487e0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff1dc001930 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3866569009 0 0) 0x7ff1ec06df50 con 0x7ff1ec142ce0 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1d80035d0 con 0x7ff1ec142ce0 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff1e4001f80 con 0x7ff1ec142ce0 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1675357253 0 0) 0x7ff1ec1487e0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 >> v1:172.21.15.177:6789/0 conn(0x7ff1ec0ae580 legacy=0x7ff1ec13eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 >> v1:172.21.15.73:6789/0 conn(0x7ff1ec142ce0 legacy=0x7ff1ec13f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec145370 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec1dd410 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec1495e0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff1dc001cc0 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.154+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7ff1dc003b10 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.158+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc005100 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.158+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7ff1dc003c70 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.158+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7ff1dc07f680 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.162+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7ff1dc04ce00 con 0x7ff1ec0a9a70 2024-09-16T14:37:22.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.314+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1cc000b90 con 0x7ff1d80672f0 2024-09-16T14:37:22.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.318+0000 7ff1d37fe700 1 -- 172.21.15.73:0/529066465 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48604 (unknown 2965378022 0 108928014) 0x7ff1cc000b90 con 0x7ff1d80672f0 2024-09-16T14:37:22.323 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.322+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 >> v1:172.21.15.177:6816/2823028339 conn(0x7ff1d80672f0 legacy=0x7ff1d80697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.322+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 >> v1:172.21.15.73:6790/0 conn(0x7ff1ec0a9a70 legacy=0x7ff1ec148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.322+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 shutdown_connections 2024-09-16T14:37:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.322+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 >> 172.21.15.73:0/529066465 conn(0x7ff1ec06a360 msgr2=0x7ff1ec0abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.322+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 shutdown_connections 2024-09-16T14:37:22.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.322+0000 7ff1f1249700 1 -- 172.21.15.73:0/529066465 wait complete. 2024-09-16T14:37:22.329 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:37:22.341 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-09-16T14:37:21.146040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225836,"kb_used_data":1436,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754748884,"statfs":{"total":773094113280,"available":772862857216,"internally_reserved":0,"allocated":1470464,"data_stored":1496274,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":12744,"internal_metadata":229625400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":590387,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.844744"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.311977+0000","last_change":"2024-09-16T14:37:18.312221+0000","last_active":"2024-09-16T14:37:18.311977+0000","last_peered":"2024-09-16T14:37:18.311977+0000","last_clean":"2024-09-16T14:37:18.311977+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:37:18.311977+0000","last_undegraded":"2024-09-16T14:37:18.311977+0000","last_fullsized":"2024-09-16T14:37:18.311977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:52.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.305432+0000","last_change":"2024-09-16T14:37:18.305901+0000","last_active":"2024-09-16T14:37:18.305432+0000","last_peered":"2024-09-16T14:37:18.305432+0000","last_clean":"2024-09-16T14:37:18.305432+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:37:18.305432+0000","last_undegraded":"2024-09-16T14:37:18.305432+0000","last_fullsized":"2024-09-16T14:37:18.305432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:15:04.908893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.311489+0000","last_change":"2024-09-16T14:37:18.311955+0000","last_active":"2024-09-16T14:37:18.311489+0000","last_peered":"2024-09-16T14:37:18.311489+0000","last_clean":"2024-09-16T14:37:18.311489+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:37:18.311489+0000","last_undegraded":"2024-09-16T14:37:18.311489+0000","last_fullsized":"2024-09-16T14:37:18.311489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:15.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.444725+0000","last_change":"2024-09-16T14:37:18.445088+0000","last_active":"2024-09-16T14:37:18.444725+0000","last_peered":"2024-09-16T14:37:18.444725+0000","last_clean":"2024-09-16T14:37:18.444725+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:37:18.444725+0000","last_undegraded":"2024-09-16T14:37:18.444725+0000","last_fullsized":"2024-09-16T14:37:18.444725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:26:02.071763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.311825+0000","last_change":"2024-09-16T14:37:18.311825+0000","last_active":"2024-09-16T14:37:18.311825+0000","last_peered":"2024-09-16T14:37:18.311825+0000","last_clean":"2024-09-16T14:37:18.311825+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:37:18.311825+0000","last_undegraded":"2024-09-16T14:37:18.311825+0000","last_fullsized":"2024-09-16T14:37:18.311825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:34.098272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.445545+0000","last_change":"2024-09-16T14:37:18.446072+0000","last_active":"2024-09-16T14:37:18.445545+0000","last_peered":"2024-09-16T14:37:18.445545+0000","last_clean":"2024-09-16T14:37:18.445545+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:37:18.445545+0000","last_undegraded":"2024-09-16T14:37:18.445545+0000","last_fullsized":"2024-09-16T14:37:18.445545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:00:52.557322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.310544+0000","last_change":"2024-09-16T14:37:18.310876+0000","last_active":"2024-09-16T14:37:18.310544+0000","last_peered":"2024-09-16T14:37:18.310544+0000","last_clean":"2024-09-16T14:37:18.310544+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:37:18.310544+0000","last_undegraded":"2024-09-16T14:37:18.310544+0000","last_fullsized":"2024-09-16T14:37:18.310544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:54.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-16T14:37:18.312049+0000","last_change":"2024-09-16T14:37:18.312343+0000","last_active":"2024-09-16T14:37:18.312049+0000","last_peered":"2024-09-16T14:37:18.312049+0000","last_clean":"2024-09-16T14:37:18.312049+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:37:18.312049+0000","last_undegraded":"2024-09-16T14:37:18.312049+0000","last_fullsized":"2024-09-16T14:37:18.312049+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:47:21.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-16T14:37:17.300710+0000","last_change":"2024-09-16T14:37:15.105418+0000","last_active":"2024-09-16T14:37:17.300710+0000","last_peered":"2024-09-16T14:37:17.300710+0000","last_clean":"2024-09-16T14:37:17.300710+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:37:17.300710+0000","last_undegraded":"2024-09-16T14:37:17.300710+0000","last_fullsized":"2024-09-16T14:37:17.300710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_clean_scrub_stamp":"2024-09-16T14:37:13.233269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:11.758633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31288,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340552,"statfs":{"total":96636764160,"available":96604725248,"internally_reserved":0,"allocated":167936,"data_stored":53980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":583845,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":229376,"data_stored":583845,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":54917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":54936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:37:22.342 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T14:37:22.342 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T14:37:22.342 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T14:37:22.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T14:37:22.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.438+0000 7fb2cf59e700 1 Processor -- start 2024-09-16T14:37:22.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.438+0000 7fb2cf59e700 1 -- start start 2024-09-16T14:37:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.438+0000 7fb2cf59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d013f940 con 0x7fb2d013c1e0 2024-09-16T14:37:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.438+0000 7fb2cf59e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d013ed10 con 0x7fb2d00aeea0 2024-09-16T14:37:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.438+0000 7fb2cf59e700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d013c6b0 con 0x7fb2d00ae410 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2ced9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb2d013c1e0 0x7fb2d014a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47490/0 (socket says 172.21.15.73:47490) 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2ced9d700 1 -- 172.21.15.73:0/182888365 learned_addr learned my addr 172.21.15.73:0/182888365 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715081285 0 0) 0x7fb2d013f940 con 0x7fb2d013c1e0 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2bc0035d0 con 0x7fb2d013c1e0 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782908986 0 0) 0x7fb2d013c6b0 con 0x7fb2d00ae410 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d013f940 con 0x7fb2d00ae410 2024-09-16T14:37:22.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3887004801 0 0) 0x7fb2d013f940 con 0x7fb2d00ae410 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 >> v1:172.21.15.177:6789/0 conn(0x7fb2d00aeea0 legacy=0x7fb2d013bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 >> v1:172.21.15.73:6789/0 conn(0x7fb2d013c1e0 legacy=0x7fb2d014a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0072680 con 0x7fb2d00ae410 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb2c0001610 con 0x7fb2d00ae410 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb2c00018b0 con 0x7fb2d00ae410 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cd59a700 1 -- 172.21.15.73:0/182888365 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb2c0001c40 con 0x7fb2d00ae410 2024-09-16T14:37:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cf59e700 1 -- 172.21.15.73:0/182888365 >> v1:172.21.15.73:6790/0 conn(0x7fb2d00ae410 legacy=0x7fb2d013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cf59e700 1 -- 172.21.15.73:0/182888365 shutdown_connections 2024-09-16T14:37:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cf59e700 1 -- 172.21.15.73:0/182888365 >> 172.21.15.73:0/182888365 conn(0x7fb2d00af290 msgr2=0x7fb2d00af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cf59e700 1 -- 172.21.15.73:0/182888365 shutdown_connections 2024-09-16T14:37:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.442+0000 7fb2cf59e700 1 -- 172.21.15.73:0/182888365 wait complete. 2024-09-16T14:37:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 Processor -- start 2024-09-16T14:37:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 -- start start 2024-09-16T14:37:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d01332b0 con 0x7fb2d00ae410 2024-09-16T14:37:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d0134000 con 0x7fb2d013c1e0 2024-09-16T14:37:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d01342e0 con 0x7fb2d00702a0 2024-09-16T14:37:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2ced9d700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb2d00702a0 0x7fb2d01de2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52178/0 (socket says 172.21.15.73:52178) 2024-09-16T14:37:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2ced9d700 1 -- 172.21.15.73:0/2970127361 learned_addr learned my addr 172.21.15.73:0/2970127361 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2ce59c700 1 --1- 172.21.15.73:0/2970127361 >> v1:172.21.15.73:6789/0 conn(0x7fb2d00ae410 0x7fb2d0132ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47496/0 (socket says 172.21.15.73:47496) 2024-09-16T14:37:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294385818 0 0) 0x7fb2d01342e0 con 0x7fb2d00702a0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2b00035d0 con 0x7fb2d00702a0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691104359 0 0) 0x7fb2d01332b0 con 0x7fb2d00ae410 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d01342e0 con 0x7fb2d00ae410 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873798823 0 0) 0x7fb2d0134000 con 0x7fb2d013c1e0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d01332b0 con 0x7fb2d013c1e0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2290856531 0 0) 0x7fb2b00035d0 con 0x7fb2d00702a0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2d0134000 con 0x7fb2d00702a0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb2c8001b60 con 0x7fb2d00702a0 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4271930888 0 0) 0x7fb2d01342e0 con 0x7fb2d00ae410 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2b00035d0 con 0x7fb2d00ae410 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb2c0001bc0 con 0x7fb2d00ae410 2024-09-16T14:37:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2778275153 0 0) 0x7fb2d01332b0 con 0x7fb2d013c1e0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2d01342e0 con 0x7fb2d013c1e0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb2b80017f0 con 0x7fb2d013c1e0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 594431529 0 0) 0x7fb2d0134000 con 0x7fb2d00702a0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 >> v1:172.21.15.177:6789/0 conn(0x7fb2d013c1e0 legacy=0x7fb2d00708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 >> v1:172.21.15.73:6789/0 conn(0x7fb2d00ae410 legacy=0x7fb2d0132ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d006f060 con 0x7fb2d00702a0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d006f250 con 0x7fb2d00702a0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.446+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d01df9c0 con 0x7fb2d00702a0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.450+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb2c80020b0 con 0x7fb2d00702a0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.450+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb2c8004db0 con 0x7fb2d00702a0 2024-09-16T14:37:22.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.450+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4005100 con 0x7fb2d00702a0 2024-09-16T14:37:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.450+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fb2c8019f50 con 0x7fb2d00702a0 2024-09-16T14:37:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.450+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7fb2c807f6e0 con 0x7fb2d00702a0 2024-09-16T14:37:22.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.458+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fb2c804cdf0 con 0x7fb2d00702a0 2024-09-16T14:37:22.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.646+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb2b4005930 con 0x7fb2d00702a0 2024-09-16T14:37:22.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.646+0000 7fb2c6ffd700 1 -- 172.21.15.73:0/2970127361 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7fb2c804eef0 con 0x7fb2d00702a0 2024-09-16T14:37:22.652 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:37:22.652 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T14:37:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.650+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 >> v1:172.21.15.177:6816/2823028339 conn(0x7fb2b0067480 legacy=0x7fb2b0069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.650+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 >> v1:172.21.15.73:6790/0 conn(0x7fb2d00702a0 legacy=0x7fb2d01de2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.650+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 shutdown_connections 2024-09-16T14:37:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.650+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 >> 172.21.15.73:0/2970127361 conn(0x7fb2d00af290 msgr2=0x7fb2d00af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.650+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 shutdown_connections 2024-09-16T14:37:22.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.650+0000 7fb2cf59e700 1 -- 172.21.15.73:0/2970127361 wait complete. 2024-09-16T14:37:22.664 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T14:37:22.665 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T14:37:22.674 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T14:37:22.675 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:37:22.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool create cephsqlite' 2024-09-16T14:37:22.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.774+0000 7f27c8890700 1 Processor -- start 2024-09-16T14:37:22.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.774+0000 7f27c8890700 1 -- start start 2024-09-16T14:37:22.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c40a9c40 con 0x7f27c413b440 2024-09-16T14:37:22.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c40a9f20 con 0x7f27c40b30c0 2024-09-16T14:37:22.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c40abbb0 con 0x7f27c4071a80 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c259c700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f27c4071a80 0x7f27c413ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52186/0 (socket says 172.21.15.73:52186) 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c259c700 1 -- 172.21.15.73:0/3134051153 learned_addr learned my addr 172.21.15.73:0/3134051153 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081741861 0 0) 0x7f27c40a9c40 con 0x7f27c413b440 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ac0035d0 con 0x7f27c413b440 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284465820 0 0) 0x7f27c40abbb0 con 0x7f27c4071a80 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c40a9c40 con 0x7f27c4071a80 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912058892 0 0) 0x7f27c40a9f20 con 0x7f27c40b30c0 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c40abbb0 con 0x7f27c40b30c0 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851897349 0 0) 0x7f27ac0035d0 con 0x7f27c413b440 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 >> v1:172.21.15.73:6790/0 conn(0x7f27c4071a80 legacy=0x7f27c413ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 >> v1:172.21.15.177:6789/0 conn(0x7f27c40b30c0 legacy=0x7f27c40abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40ac670 con 0x7f27c413b440 2024-09-16T14:37:22.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f27bc001990 con 0x7f27c413b440 2024-09-16T14:37:22.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f27bc001c00 con 0x7f27c413b440 2024-09-16T14:37:22.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c1d9b700 1 -- 172.21.15.73:0/3134051153 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f27bc001fd0 con 0x7f27c413b440 2024-09-16T14:37:22.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- 172.21.15.73:0/3134051153 >> v1:172.21.15.73:6789/0 conn(0x7f27c413b440 legacy=0x7f27c4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- 172.21.15.73:0/3134051153 shutdown_connections 2024-09-16T14:37:22.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- 172.21.15.73:0/3134051153 >> 172.21.15.73:0/3134051153 conn(0x7f27c40666f0 msgr2=0x7f27c40b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:22.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- 172.21.15.73:0/3134051153 shutdown_connections 2024-09-16T14:37:22.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 -- 172.21.15.73:0/3134051153 wait complete. 2024-09-16T14:37:22.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.778+0000 7f27c8890700 1 Processor -- start 2024-09-16T14:37:22.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- start start 2024-09-16T14:37:22.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c413cda0 con 0x7f27c4071a80 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c413b820 con 0x7f27c40b30c0 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c413bb20 con 0x7f27c413b440 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c359e700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f27c413b440 0x7f27c41dc1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52202/0 (socket says 172.21.15.73:52202) 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c359e700 1 -- 172.21.15.73:0/3708854023 learned_addr learned my addr 172.21.15.73:0/3708854023 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c2d9d700 1 -- 172.21.15.73:0/3708854023 >> v1:172.21.15.73:6789/0 conn(0x7f27c4071a80 legacy=0x7f27c41d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c2d9d700 1 -- 172.21.15.73:0/3708854023 >> v1:172.21.15.73:6789/0 conn(0x7f27c4071a80 legacy=0x7f27c41d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c2d9d700 1 --1- 172.21.15.73:0/3708854023 >> v1:172.21.15.73:6789/0 conn(0x7f27c4071a80 0x7f27c41d4c50 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c2d9d700 1 --1- 172.21.15.73:0/3708854023 >> v1:172.21.15.73:6789/0 conn(0x7f27c4071a80 0x7f27c41d4c50 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928785547 0 0) 0x7f27c413bb20 con 0x7f27c413b440 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b00035d0 con 0x7f27c413b440 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2355031447 0 0) 0x7f27b00035d0 con 0x7f27c413b440 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27c413bb20 con 0x7f27c413b440 2024-09-16T14:37:22.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f27bc001f10 con 0x7f27c413b440 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988585497 0 0) 0x7f27c413b820 con 0x7f27c40b30c0 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b00035d0 con 0x7f27c40b30c0 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 965762993 0 0) 0x7f27c413bb20 con 0x7f27c413b440 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 >> v1:172.21.15.177:6789/0 conn(0x7f27c40b30c0 legacy=0x7f27c41d5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 >> v1:172.21.15.73:6789/0 conn(0x7f27c4071a80 legacy=0x7f27c41d4c50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c413bcb0 con 0x7f27c413b440 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c413e5a0 con 0x7f27c413b440 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c413c6a0 con 0x7f27c413b440 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f27bc003dc0 con 0x7f27c413b440 2024-09-16T14:37:22.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f27bc004150 con 0x7f27c413b440 2024-09-16T14:37:22.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a4005100 con 0x7f27c413b440 2024-09-16T14:37:22.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.782+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f27bc004330 con 0x7f27c413b440 2024-09-16T14:37:22.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.786+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(19..19 src has 1..19) v4 ==== 4146+0+0 (unknown 1137632054 0 0) 0x7f27bc07fae0 con 0x7f27c413b440 2024-09-16T14:37:22.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.790+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f27bc04d0d0 con 0x7f27c413b440 2024-09-16T14:37:22.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:22.942+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "cephsqlite"} v 0) v1 -- 0x7f27a40053b0 con 0x7f27c413b440 2024-09-16T14:37:23.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.338+0000 7f27ab7fe700 1 -- 172.21.15.73:0/3708854023 <== mon.2 v1:172.21.15.73:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephsqlite"}]=0 pool 'cephsqlite' created v20) v1 ==== 110+0+0 (unknown 2615499700 0 0) 0x7f27bc001550 con 0x7f27c413b440 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.342+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 >> v1:172.21.15.177:6816/2823028339 conn(0x7f27b0067250 legacy=0x7f27b0069710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.342+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 >> v1:172.21.15.73:6790/0 conn(0x7f27c413b440 legacy=0x7f27c41dc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.342+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 shutdown_connections 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.342+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 >> 172.21.15.73:0/3708854023 conn(0x7f27c40666f0 msgr2=0x7f27c413ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.342+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 shutdown_connections 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.342+0000 7f27c8890700 1 -- 172.21.15.73:0/3708854023 wait complete. 2024-09-16T14:37:23.347 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephsqlite' created 2024-09-16T14:37:23.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph auth get-or-create client.libcephsqlite mon '"'"'profile simple-rados-client-with-blocklist'"'"' osd '"'"'allow rwx pool=cephsqlite'"'"' >> /etc/ceph/ceph.keyring' 2024-09-16T14:37:23.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.466+0000 7fc888d96700 1 Processor -- start 2024-09-16T14:37:23.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.466+0000 7fc888d96700 1 -- start start 2024-09-16T14:37:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8840b3150 con 0x7fc8840b0de0 2024-09-16T14:37:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8840a9e80 con 0x7fc8840b0950 2024-09-16T14:37:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88414f520 con 0x7fc8840b37b0 2024-09-16T14:37:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc883fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc8840b0de0 0x7fc884144960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47508/0 (socket says 172.21.15.73:47508) 2024-09-16T14:37:23.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc883fff700 1 -- 172.21.15.73:0/4188440247 learned_addr learned my addr 172.21.15.73:0/4188440247 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:23.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8837fe700 1 --1- 172.21.15.73:0/4188440247 >> v1:172.21.15.73:6790/0 conn(0x7fc8840b37b0 0x7fc8840b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:52204/0 (socket says 172.21.15.73:52204) 2024-09-16T14:37:23.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774668804 0 0) 0x7fc8840b3150 con 0x7fc8840b0de0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc86c0035d0 con 0x7fc8840b0de0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786038223 0 0) 0x7fc88414f520 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8840b3150 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926283180 0 0) 0x7fc8840a9e80 con 0x7fc8840b0950 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc88414f520 con 0x7fc8840b0950 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829771835 0 0) 0x7fc8840b3150 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 >> v1:172.21.15.177:6789/0 conn(0x7fc8840b0950 legacy=0x7fc884144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 >> v1:172.21.15.73:6789/0 conn(0x7fc8840b0de0 legacy=0x7fc884144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8841506c0 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8780015f0 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8780018a0 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc8827fc700 1 -- 172.21.15.73:0/4188440247 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc878001c30 con 0x7fc8840b37b0 2024-09-16T14:37:23.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- 172.21.15.73:0/4188440247 >> v1:172.21.15.73:6790/0 conn(0x7fc8840b37b0 legacy=0x7fc8840b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- 172.21.15.73:0/4188440247 shutdown_connections 2024-09-16T14:37:23.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- 172.21.15.73:0/4188440247 >> 172.21.15.73:0/4188440247 conn(0x7fc884066bd0 msgr2=0x7fc88406b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:23.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- 172.21.15.73:0/4188440247 shutdown_connections 2024-09-16T14:37:23.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.470+0000 7fc888d96700 1 -- 172.21.15.73:0/4188440247 wait complete. 2024-09-16T14:37:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 Processor -- start 2024-09-16T14:37:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 -- start start 2024-09-16T14:37:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8840b0060 con 0x7fc8840b0de0 2024-09-16T14:37:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88413b870 con 0x7fc8840b37b0 2024-09-16T14:37:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc884141890 con 0x7fc8840b0950 2024-09-16T14:37:23.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc882ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc8840b0de0 0x7fc88413bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47516/0 (socket says 172.21.15.73:47516) 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc882ffd700 1 -- 172.21.15.73:0/514095558 learned_addr learned my addr 172.21.15.73:0/514095558 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632324826 0 0) 0x7fc8840b0060 con 0x7fc8840b0de0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8700035d0 con 0x7fc8840b0de0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672048864 0 0) 0x7fc884141890 con 0x7fc8840b0950 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8840b0060 con 0x7fc8840b0950 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551753705 0 0) 0x7fc88413b870 con 0x7fc8840b37b0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc884141890 con 0x7fc8840b37b0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1774910681 0 0) 0x7fc8700035d0 con 0x7fc8840b0de0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc88413b870 con 0x7fc8840b0de0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc874001930 con 0x7fc8840b0de0 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2302943336 0 0) 0x7fc8840b0060 con 0x7fc8840b0950 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc8700035d0 con 0x7fc8840b0950 2024-09-16T14:37:23.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc8780015f0 con 0x7fc8840b0950 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2407792514 0 0) 0x7fc88413b870 con 0x7fc8840b0de0 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 >> v1:172.21.15.73:6790/0 conn(0x7fc8840b0950 legacy=0x7fc884141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 >> v1:172.21.15.177:6789/0 conn(0x7fc8840b37b0 legacy=0x7fc88413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8841407a0 con 0x7fc8840b0de0 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc884140a80 con 0x7fc8840b0de0 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88413def0 con 0x7fc8840b0de0 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc874001cc0 con 0x7fc8840b0de0 2024-09-16T14:37:23.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.474+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc874003b10 con 0x7fc8840b0de0 2024-09-16T14:37:23.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.478+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc864005100 con 0x7fc8840b0de0 2024-09-16T14:37:23.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.478+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fc874003c70 con 0x7fc8840b0de0 2024-09-16T14:37:23.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.478+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(20..20 src has 1..20) v4 ==== 4467+0+0 (unknown 231574227 0 0) 0x7fc87407f630 con 0x7fc8840b0de0 2024-09-16T14:37:23.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.486+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fc87404cdd0 con 0x7fc8840b0de0 2024-09-16T14:37:23.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.714+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]} v 0) v1 -- 0x7fc864005930 con 0x7fc8840b0de0 2024-09-16T14:37:23.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.722+0000 7fc86bfff700 1 -- 172.21.15.73:0/514095558 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]}]=0 v15) v1 ==== 199+0+71 (unknown 3040008346 0 2430613945) 0x7fc87404ed00 con 0x7fc8840b0de0 2024-09-16T14:37:23.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.726+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 >> v1:172.21.15.177:6816/2823028339 conn(0x7fc870067180 legacy=0x7fc870069640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.726+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 >> v1:172.21.15.73:6789/0 conn(0x7fc8840b0de0 legacy=0x7fc88413bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:37:23.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.726+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 shutdown_connections 2024-09-16T14:37:23.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.726+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 >> 172.21.15.73:0/514095558 conn(0x7fc884066bd0 msgr2=0x7fc8840a8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:37:23.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.726+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 shutdown_connections 2024-09-16T14:37:23.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:37:23.726+0000 7fc888d96700 1 -- 172.21.15.73:0/514095558 wait complete. 2024-09-16T14:37:23.742 INFO:teuthology.run_tasks:Running task exec... 2024-09-16T14:37:23.753 INFO:teuthology.task.exec:Executing custom commands... 2024-09-16T14:37:23.753 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:37:23.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr' 2024-09-16T14:37:23.796 INFO:teuthology.orchestra.run.smithi073.stdout:[==========] Running 20 tests from 1 test suite. 2024-09-16T14:37:23.796 INFO:teuthology.orchestra.run.smithi073.stdout:[----------] Global test environment set-up. 2024-09-16T14:37:23.796 INFO:teuthology.orchestra.run.smithi073.stdout:[----------] 20 tests from CephSQLiteTest 2024-09-16T14:37:28.807 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.Create 2024-09-16T14:37:28.826 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/db9f7e11-ba02-406e-9f81-23014a9e3347.db?vfs=ceph 2024-09-16T14:37:28.826 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:28.835 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a INT); 2024-09-16T14:37:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.Create (54 ms) 2024-09-16T14:37:28.861 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertBulk4096 2024-09-16T14:37:28.881 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/42182b70-4b6c-41e8-9eef-5103983cbda7.db?vfs=ceph 2024-09-16T14:37:28.881 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:28.890 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA page_size = 4096;CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000;PRAGMA page_size; 2024-09-16T14:37:32.136 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertBulk4096 (3276 ms) 2024-09-16T14:37:32.136 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertBulk 2024-09-16T14:37:32.155 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/22b9f308-7140-40e4-9c01-e66950c2c271.db?vfs=ceph 2024-09-16T14:37:32.156 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:32.165 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000; 2024-09-16T14:37:32.730 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertBulk (594 ms) 2024-09-16T14:37:32.731 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.UpdateBulk 2024-09-16T14:37:32.744 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/fc2bea18-31ca-4ec5-9684-17aa1a5a3603.db?vfs=ceph 2024-09-16T14:37:32.744 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:32.752 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;SELECT SUM(a) FROM foo;UPDATE foo SET a = a+a;SELECT SUM(a) FROM foo; 2024-09-16T14:37:33.687 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.UpdateBulk (956 ms) 2024-09-16T14:37:33.687 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertRate 2024-09-16T14:37:33.703 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/c205b8bf-8992-4843-b49b-ee65c13786a7.db?vfs=ceph 2024-09-16T14:37:33.703 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:33.712 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-16T14:37:36.569 INFO:teuthology.orchestra.run.smithi073.stdout:transactions per second: 35.3115 2024-09-16T14:37:36.569 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertRate (2883 ms) 2024-09-16T14:37:36.570 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.DatabaseShrink 2024-09-16T14:37:36.585 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/fce35c67-80aa-45fc-98b9-492a82c11c8e.db?vfs=ceph 2024-09-16T14:37:36.586 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:36.592 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%4 < 3;VACUUM; 2024-09-16T14:37:38.133 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.DatabaseShrink (1563 ms) 2024-09-16T14:37:38.133 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveRate 2024-09-16T14:37:38.148 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/5771e034-f294-4525-b654-4962eac514ce.db?vfs=ceph 2024-09-16T14:37:38.148 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:38.157 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-16T14:37:39.562 INFO:teuthology.orchestra.run.smithi073.stdout:transactions per second: 72.4654 2024-09-16T14:37:39.566 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertExclusiveRate (1433 ms) 2024-09-16T14:37:39.566 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveWALRate 2024-09-16T14:37:39.581 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/66f3f17a-e249-4859-a0a8-47270bbf2a57.db?vfs=ceph 2024-09-16T14:37:39.581 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:39.588 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-16T14:37:40.185 INFO:teuthology.orchestra.run.smithi073.stdout:transactions per second: 183.828 2024-09-16T14:37:40.209 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertExclusiveWALRate (643 ms) 2024-09-16T14:37:40.209 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.WALTransactionSync 2024-09-16T14:37:40.220 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/630959cb-b314-4bf0-aed0-91e748d19200.db?vfs=ceph 2024-09-16T14:37:40.220 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:40.225 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO perf (v) VALUES (ceph_perf());BEGIN TRANSACTION;INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-09-16T14:37:40.302 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.WALTransactionSync (93 ms) 2024-09-16T14:37:40.302 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.PersistTransactionSync 2024-09-16T14:37:40.312 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/cba5ab96-875d-450c-a83a-7694bcd00d20.db?vfs=ceph 2024-09-16T14:37:40.313 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:40.318 INFO:teuthology.orchestra.run.smithi073.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-09-16T14:37:40.358 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.PersistTransactionSync (56 ms) 2024-09-16T14:37:40.358 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveLock 2024-09-16T14:37:40.373 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/37d7c20d-713a-4e3b-a457-c20deb94737c.db?vfs=ceph 2024-09-16T14:37:40.373 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:40.382 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount';SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.lock' AND b.fullkey = '$.libcephsqlite_striper.lock'; 2024-09-16T14:37:40.432 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertExclusiveLock (74 ms) 2024-09-16T14:37:40.432 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.TransactionSizeUpdate 2024-09-16T14:37:40.450 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/8eefabbe-d228-4800-9c53-c41a7b327008.db?vfs=ceph 2024-09-16T14:37:40.450 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:40.458 INFO:teuthology.orchestra.run.smithi073.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_size' AND b.fullkey = '$.libcephsqlite_striper.update_size'; 2024-09-16T14:37:40.505 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.TransactionSizeUpdate (73 ms) 2024-09-16T14:37:40.505 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.AllocatedGrowth 2024-09-16T14:37:40.523 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/c65e4168-a8ce-4388-a4d6-39ab7a890d19.db?vfs=ceph 2024-09-16T14:37:40.523 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:40.529 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_allocated' AND b.fullkey = '$.libcephsqlite_striper.update_allocated'; 2024-09-16T14:37:48.095 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.AllocatedGrowth (7589 ms) 2024-09-16T14:37:48.095 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.DeleteBulk 2024-09-16T14:37:48.109 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/815572b1-d013-4bef-ba31-3e0d5fc0243b.db?vfs=ceph 2024-09-16T14:37:48.109 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:48.116 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%2 == 0; 2024-09-16T14:37:48.996 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.DeleteBulk (901 ms) 2024-09-16T14:37:49.116 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.DropMassive 2024-09-16T14:37:49.117 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/c7c04007-ef1c-4cd2-86b1-fa49e094bdf6.db?vfs=ceph 2024-09-16T14:37:49.117 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:37:49.117 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;DROP TABLE foo;VACUUM;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink' AND b.fullkey = '$.libcephsqlite_striper.shrink';SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink_bytes' AND b.fullkey = '$.libcephsqlite_striper.shrink_bytes'; 2024-09-16T14:38:22.945 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.DropMassive (33949 ms) 2024-09-16T14:38:22.946 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.InsertMassiveVerify 2024-09-16T14:38:22.963 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/41a60185-94cf-4bbd-beee-5e70dc8a1e4e.db?vfs=ceph 2024-09-16T14:38:22.963 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:38:22.972 INFO:teuthology.orchestra.run.smithi073.stdout:CREATE TABLE foo (a BLOB);CREATE TEMPORARY TABLE bar (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO bar (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;SELECT a FROM bar;INSERT INTO foo (a) SELECT a FROM bar;SELECT a FROM foo; 2024-09-16T14:38:38.302 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.InsertMassiveVerify (15358 ms) 2024-09-16T14:38:38.303 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.PerfValid 2024-09-16T14:38:38.319 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/7a02a089-16b4-4b82-b62a-500d738a5962.db?vfs=ceph 2024-09-16T14:38:38.319 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:38:38.328 INFO:teuthology.orchestra.run.smithi073.stdout:SELECT json_valid(ceph_perf()); 2024-09-16T14:38:38.329 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.PerfValid (27 ms) 2024-09-16T14:38:38.329 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.StatusValid 2024-09-16T14:38:38.349 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/f70c585f-4bef-4c79-ac86-1115434561c6.db?vfs=ceph 2024-09-16T14:38:38.349 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:38:38.360 INFO:teuthology.orchestra.run.smithi073.stdout:SELECT json_valid(ceph_status()); 2024-09-16T14:38:38.361 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.StatusValid (31 ms) 2024-09-16T14:38:38.361 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.CurrentTime 2024-09-16T14:38:38.377 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/03641825-dedb-4d75-97ec-5019c25b0f75.db?vfs=ceph 2024-09-16T14:38:38.377 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:38:38.388 INFO:teuthology.orchestra.run.smithi073.stdout:SELECT strftime('%s', 'now'); 2024-09-16T14:38:38.389 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.CurrentTime (28 ms) 2024-09-16T14:38:38.389 INFO:teuthology.orchestra.run.smithi073.stdout:[ RUN ] CephSQLiteTest.StatusFields 2024-09-16T14:38:38.408 INFO:teuthology.orchestra.run.smithi073.stdout:using database: file:cephsqlite:/c367a67a-f566-47c2-8a7e-fe2273ea82ad.db?vfs=ceph 2024-09-16T14:38:38.408 INFO:teuthology.orchestra.run.smithi073.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-16T14:38:38.423 INFO:teuthology.orchestra.run.smithi073.stdout:SELECT json_extract(ceph_status(), '$.addr');SELECT json_extract(ceph_status(), '$.id'); 2024-09-16T14:38:38.423 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73:0/985886055 2024-09-16T14:38:38.424 INFO:teuthology.orchestra.run.smithi073.stdout:4433 2024-09-16T14:38:38.425 INFO:teuthology.orchestra.run.smithi073.stdout:[ OK ] CephSQLiteTest.StatusFields (36 ms) 2024-09-16T14:38:38.425 INFO:teuthology.orchestra.run.smithi073.stdout:[----------] 20 tests from CephSQLiteTest (69618 ms total) 2024-09-16T14:38:38.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:38:38.425 INFO:teuthology.orchestra.run.smithi073.stdout:[----------] Global test environment tear-down 2024-09-16T14:38:38.425 INFO:teuthology.orchestra.run.smithi073.stdout:[==========] 20 tests from 1 test suite ran. (74629 ms total) 2024-09-16T14:38:38.425 INFO:teuthology.orchestra.run.smithi073.stdout:[ PASSED ] 20 tests. 2024-09-16T14:38:38.466 INFO:teuthology.run_tasks:Running task workunit... 2024-09-16T14:38:38.481 INFO:tasks.workunit:Pulling workunits from ref ae7f37330c1a72493684eb1fcaed6f2a01195bb6 2024-09-16T14:38:38.481 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T14:38:38.481 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T14:38:38.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:38:38.515 INFO:teuthology.orchestra.run.smithi073.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-16T14:38:38.515 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T14:38:38.538 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-16T14:38:38.539 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-16T14:38:38.546 INFO:tasks.workunit:timeout=3h 2024-09-16T14:38:38.546 INFO:tasks.workunit:cleanup=True 2024-09-16T14:38:38.546 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ae7f37330c1a72493684eb1fcaed6f2a01195bb6 2024-09-16T14:38:38.555 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T14:39:36.584 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to 'ae7f37330c1a72493684eb1fcaed6f2a01195bb6'. 2024-09-16T14:39:36.584 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.584 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T14:39:36.584 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T14:39:36.584 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-09-16T14:39:36.585 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.586 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T14:39:36.586 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:36.586 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at ae7f37330c1 Merge pull request #59795 from zdover23/wip-doc-2024-09-15-backport-59613-to-reef 2024-09-16T14:39:36.590 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T14:39:36.648 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T14:39:36.651 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T14:39:36.651 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T14:39:37.533 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T14:39:37.649 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T14:39:37.708 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T14:39:37.709 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T14:39:37.710 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T14:39:37.770 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T14:39:37.776 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-16T14:39:37.776 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T14:39:37.782 INFO:tasks.workunit:Running workunits matching rados/test_libcephsqlite.sh on client.0... 2024-09-16T14:39:37.784 INFO:tasks.workunit:Running workunit rados/test_libcephsqlite.sh... 2024-09-16T14:39:37.784 DEBUG:teuthology.orchestra.run.smithi073:workunit test rados/test_libcephsqlite.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ae7f37330c1a72493684eb1fcaed6f2a01195bb6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CEPH_ARGS='--id libcephsqlite --no-log-to-stderr' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh cephsqlite 2024-09-16T14:39:37.795 INFO:tasks.workunit.client.0.smithi073.stderr:+ pool=cephsqlite 2024-09-16T14:39:37.795 INFO:tasks.workunit.client.0.smithi073.stderr:++ basename /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh 2024-09-16T14:39:37.797 INFO:tasks.workunit.client.0.smithi073.stderr:+ ns=test_libcephsqlite.sh 2024-09-16T14:39:37.797 INFO:tasks.workunit.client.0.smithi073.stderr:+ striper rm baz.db 2024-09-16T14:39:37.797 INFO:tasks.workunit.client.0.smithi073.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-16T14:39:37.868 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite 2024-09-16T14:39:37.868 INFO:tasks.workunit.client.0.smithi073.stderr:+ background= 2024-09-16T14:39:37.868 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' '' = b ']' 2024-09-16T14:39:37.869 INFO:tasks.workunit.client.0.smithi073.stderr:++ cat 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:+ a='create table if not exists foo (a INT); 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:insert into foo (a) values (RANDOM()); 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:drop table foo;' 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:+ printf %s 'create table if not exists foo (a INT); 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:insert into foo (a) values (RANDOM()); 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:drop table foo;' 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:create table if not exists foo (a INT); 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:insert into foo (a) values (RANDOM()); 2024-09-16T14:39:37.870 INFO:tasks.workunit.client.0.smithi073.stderr:drop table foo;+ '[' '' '!=' b ']' 2024-09-16T14:39:37.871 INFO:tasks.workunit.client.0.smithi073.stderr:+ wait 2024-09-16T14:39:37.871 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:39:38.159 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:38.159 INFO:tasks.workunit.client.0.smithi073.stderr:real 0m0.291s 2024-09-16T14:39:38.159 INFO:tasks.workunit.client.0.smithi073.stderr:user 0m0.082s 2024-09-16T14:39:38.159 INFO:tasks.workunit.client.0.smithi073.stderr:sys 0m0.015s 2024-09-16T14:39:38.159 INFO:tasks.workunit.client.0.smithi073.stderr:+ striper stat baz.db 2024-09-16T14:39:38.159 INFO:tasks.workunit.client.0.smithi073.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper stat baz.db 2024-09-16T14:39:38.205 INFO:tasks.workunit.client.0.smithi073.stdout:cephsqlite/baz.db mtime 2024-09-16T14:39:38.000000+0000, size 8192 2024-09-16T14:39:38.210 INFO:tasks.workunit.client.0.smithi073.stderr:+ striper rm baz.db 2024-09-16T14:39:38.210 INFO:tasks.workunit.client.0.smithi073.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ repeat 10 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ n=10 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ shift 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i = 0 )) 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.275 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.276 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.277 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.278 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 10 )) 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:+ background= 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' '' = b ']' 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:++ cat 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:+ a='CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.279 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT LENGTH(text) FROM rand; 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:DROP TABLE rand;' 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:+ printf %s 'CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.280 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT LENGTH(text) FROM rand; 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:DROP TABLE rand;' 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.281 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT LENGTH(text) FROM rand; 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:+ wait 2024-09-16T14:39:38.282 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.246 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.434 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:39.434 INFO:tasks.workunit.client.0.smithi073.stderr:real 0m1.160s 2024-09-16T14:39:39.434 INFO:tasks.workunit.client.0.smithi073.stderr:user 0m0.137s 2024-09-16T14:39:39.434 INFO:tasks.workunit.client.0.smithi073.stderr:sys 0m0.072s 2024-09-16T14:39:39.434 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ repeat 100 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ n=100 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ shift 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i = 0 )) 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.440 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.441 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.442 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.443 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.444 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.445 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.446 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.447 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.448 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.449 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.450 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.451 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.452 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.453 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.454 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.455 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.456 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.457 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.458 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.459 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.460 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.461 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.462 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.463 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( ++i )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ (( i < 100 )) 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:+ background= 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' '' = b ']' 2024-09-16T14:39:39.464 INFO:tasks.workunit.client.0.smithi073.stderr:++ cat 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:+ a='BEGIN TRANSACTION; 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.465 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.466 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.467 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.468 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.469 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.470 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.471 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.472 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:COMMIT; 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT LENGTH(text) FROM rand; 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:DROP TABLE rand;' 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:+ printf %s 'BEGIN TRANSACTION; 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.473 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.474 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.475 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.476 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.477 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.478 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.479 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.480 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:COMMIT; 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT LENGTH(text) FROM rand; 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:DROP TABLE rand;' 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:BEGIN TRANSACTION; 2024-09-16T14:39:39.481 INFO:tasks.workunit.client.0.smithi073.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.482 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.483 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.484 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.485 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.486 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.487 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.488 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:COMMIT; 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT LENGTH(text) FROM rand; 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:+ wait 2024-09-16T14:39:39.489 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.857 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.858 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.859 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.860 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.861 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.862 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.863 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.864 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:39.865 INFO:tasks.workunit.client.0.smithi073.stdout:4096 2024-09-16T14:39:40.925 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-09-16T14:39:40.925 INFO:tasks.workunit.client.0.smithi073.stderr:real 0m1.491s 2024-09-16T14:39:40.926 INFO:tasks.workunit.client.0.smithi073.stderr:user 0m0.159s 2024-09-16T14:39:40.926 INFO:tasks.workunit.client.0.smithi073.stderr:sys 0m0.101s 2024-09-16T14:39:40.926 INFO:tasks.workunit.client.0.smithi073.stderr:+ striper rm baz.db 2024-09-16T14:39:40.926 INFO:tasks.workunit.client.0.smithi073.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-16T14:39:40.982 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:39:40.983 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:39:40 PM UTC 2024-09-16T14:39:40.984 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite b 2024-09-16T14:39:40.984 INFO:tasks.workunit.client.0.smithi073.stderr:+ background=b 2024-09-16T14:39:40.984 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' b = b ']' 2024-09-16T14:39:40.984 INFO:tasks.workunit.client.0.smithi073.stderr:+ shift 2024-09-16T14:39:40.985 INFO:tasks.workunit.client.0.smithi073.stderr:++ cat 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo VALUES ("start"); 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr:WITH RECURSIVE c(x) AS 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr: ( 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr: VALUES(1) 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr: UNION ALL 2024-09-16T14:39:40.986 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT x+1 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: ) 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo (a) 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: LIMIT (1<<20);' 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo VALUES ("start"); 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr:WITH RECURSIVE c(x) AS 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: ( 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: VALUES(1) 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: UNION ALL 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT x+1 2024-09-16T14:39:40.987 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: ) 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo (a) 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: LIMIT (1<<20);' 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr:CREATE TABLE foo (a BLOB); 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo VALUES ("start"); 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr:WITH RECURSIVE c(x) AS 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: ( 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: VALUES(1) 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: UNION ALL 2024-09-16T14:39:40.988 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT x+1 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr: ) 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo (a) 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr:+ sleep 10 2024-09-16T14:39:40.989 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:39:50.988 INFO:tasks.workunit.client.0.smithi073.stdout:done 2024-09-16T14:39:50.988 INFO:tasks.workunit.client.0.smithi073.stderr:+ echo done 2024-09-16T14:39:50.988 INFO:tasks.workunit.client.0.smithi073.stderr:+ jobs -l 2024-09-16T14:39:50.989 INFO:tasks.workunit.client.0.smithi073.stdout:[1]+ 27309 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-09-16T14:39:50.989 INFO:tasks.workunit.client.0.smithi073.stderr:++ jobs -p 2024-09-16T14:39:50.990 INFO:tasks.workunit.client.0.smithi073.stderr:+ kill -KILL -- 27309 2024-09-16T14:39:50.990 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:39:50.992 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:39:50 PM UTC 2024-09-16T14:39:50.993 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 94: 27309 Killed sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" 2024-09-16T14:39:50.993 INFO:tasks.workunit.client.0.smithi073.stderr:+ wait 2024-09-16T14:39:50.993 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:39:50.993 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:39:50 PM UTC 2024-09-16T14:39:50.994 INFO:tasks.workunit.client.0.smithi073.stderr:++ sqlite 2024-09-16T14:39:50.994 INFO:tasks.workunit.client.0.smithi073.stderr:++ background= 2024-09-16T14:39:50.994 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' '' = b ']' 2024-09-16T14:39:50.995 INFO:tasks.workunit.client.0.smithi073.stderr:+++ cat 2024-09-16T14:39:50.995 INFO:tasks.workunit.client.0.smithi073.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-09-16T14:39:50.996 INFO:tasks.workunit.client.0.smithi073.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-09-16T14:39:50.996 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-09-16T14:39:50.996 INFO:tasks.workunit.client.0.smithi073.stderr:++ wait 2024-09-16T14:39:50.996 INFO:tasks.workunit.client.0.smithi073.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:40:21.052 INFO:tasks.workunit.client.0.smithi073.stderr:+ n=1 2024-09-16T14:40:21.053 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T14:40:21.053 INFO:tasks.workunit.client.0.smithi073.stderr:+ striper rm baz.db 2024-09-16T14:40:21.053 INFO:tasks.workunit.client.0.smithi073.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-16T14:40:21.128 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:40:21.129 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:40:21 PM UTC 2024-09-16T14:40:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite b 2024-09-16T14:40:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:+ background=b 2024-09-16T14:40:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' b = b ']' 2024-09-16T14:40:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:+ shift 2024-09-16T14:40:21.130 INFO:tasks.workunit.client.0.smithi073.stderr:++ cat 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo VALUES ("start"); 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr:WITH RECURSIVE c(x) AS 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr: ( 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr: VALUES(1) 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr: UNION ALL 2024-09-16T14:40:21.131 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT x+1 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: ) 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo (a) 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: LIMIT (1<<20);' 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo VALUES ("start"); 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr:WITH RECURSIVE c(x) AS 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: ( 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: VALUES(1) 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: UNION ALL 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT x+1 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:40:21.132 INFO:tasks.workunit.client.0.smithi073.stderr: ) 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo (a) 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: LIMIT (1<<20);' 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:CREATE TABLE foo (a BLOB); 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo VALUES ("start"); 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:WITH RECURSIVE c(x) AS 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: ( 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: VALUES(1) 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: UNION ALL 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT x+1 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr: ) 2024-09-16T14:40:21.133 INFO:tasks.workunit.client.0.smithi073.stderr:INSERT INTO foo (a) 2024-09-16T14:40:21.134 INFO:tasks.workunit.client.0.smithi073.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-16T14:40:21.134 INFO:tasks.workunit.client.0.smithi073.stderr: FROM c 2024-09-16T14:40:21.134 INFO:tasks.workunit.client.0.smithi073.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-09-16T14:40:21.134 INFO:tasks.workunit.client.0.smithi073.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:40:21.134 INFO:tasks.workunit.client.0.smithi073.stderr:+ sleep 20 2024-09-16T14:40:41.133 INFO:tasks.workunit.client.0.smithi073.stderr:+ jobs -l 2024-09-16T14:40:41.133 INFO:tasks.workunit.client.0.smithi073.stdout:[1]+ 27377 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-09-16T14:40:41.135 INFO:tasks.workunit.client.0.smithi073.stderr:++ jobs -p 2024-09-16T14:40:41.136 INFO:tasks.workunit.client.0.smithi073.stderr:+ kill -STOP -- 27377 2024-09-16T14:40:41.136 INFO:tasks.workunit.client.0.smithi073.stderr:+ sleep 45 2024-09-16T14:41:26.138 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:41:26.139 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:41:26 PM UTC 2024-09-16T14:41:26.139 INFO:tasks.workunit.client.0.smithi073.stderr:++ jobs -p 2024-09-16T14:41:26.139 INFO:tasks.workunit.client.0.smithi073.stderr:+ kill -CONT -- 27377 2024-09-16T14:41:26.140 INFO:tasks.workunit.client.0.smithi073.stderr:+ sleep 10 2024-09-16T14:41:26.165 INFO:tasks.workunit.client.0.smithi073.stderr:Error: near line 3: disk I/O error 2024-09-16T14:41:36.142 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:41:36.143 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:41:36 PM UTC 2024-09-16T14:41:36.144 INFO:tasks.workunit.client.0.smithi073.stderr:+ wait 2024-09-16T14:41:36.144 INFO:tasks.workunit.client.0.smithi073.stderr:+ date 2024-09-16T14:41:36.145 INFO:tasks.workunit.client.0.smithi073.stdout:Mon 16 Sep 2024 02:41:36 PM UTC 2024-09-16T14:41:36.146 INFO:tasks.workunit.client.0.smithi073.stderr:++ sqlite 2024-09-16T14:41:36.146 INFO:tasks.workunit.client.0.smithi073.stderr:++ background= 2024-09-16T14:41:36.146 INFO:tasks.workunit.client.0.smithi073.stderr:++ '[' '' = b ']' 2024-09-16T14:41:36.146 INFO:tasks.workunit.client.0.smithi073.stderr:+++ cat 2024-09-16T14:41:36.148 INFO:tasks.workunit.client.0.smithi073.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-09-16T14:41:36.148 INFO:tasks.workunit.client.0.smithi073.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-09-16T14:41:36.148 INFO:tasks.workunit.client.0.smithi073.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-09-16T14:41:36.149 INFO:tasks.workunit.client.0.smithi073.stderr:++ wait 2024-09-16T14:41:36.149 INFO:tasks.workunit.client.0.smithi073.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-16T14:41:36.435 INFO:tasks.workunit.client.0.smithi073.stderr:+ n=1 2024-09-16T14:41:36.435 INFO:tasks.workunit.client.0.smithi073.stderr:+ '[' 1 -eq 1 ']' 2024-09-16T14:41:36.436 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T14:41:36.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T14:41:36.490 INFO:tasks.workunit:Stopping ['rados/test_libcephsqlite.sh cephsqlite'] on client.0... 2024-09-16T14:41:36.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T14:41:36.771 DEBUG:teuthology.parallel:result is None 2024-09-16T14:41:36.771 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T14:41:36.784 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T14:41:36.785 DEBUG:teuthology.orchestra.run.smithi073:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-16T14:41:36.843 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T14:41:36.843 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T14:41:36.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T14:41:36.855 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:41:36.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.964+0000 7fa155a33700 1 Processor -- start 2024-09-16T14:41:36.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.964+0000 7fa155a33700 1 -- start start 2024-09-16T14:41:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.964+0000 7fa155a33700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500a85f0 con 0x7fa150141670 2024-09-16T14:41:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.964+0000 7fa155a33700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1500704b0 con 0x7fa15006f710 2024-09-16T14:41:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.964+0000 7fa155a33700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15013e660 con 0x7fa15006d7b0 2024-09-16T14:41:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.964+0000 7fa155232700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa150141670 0x7fa150148ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40860/0 (socket says 172.21.15.73:40860) 2024-09-16T14:41:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155232700 1 -- 172.21.15.73:0/349472014 learned_addr learned my addr 172.21.15.73:0/349472014 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482619010 0 0) 0x7fa1500a85f0 con 0x7fa150141670 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1380046e0 con 0x7fa150141670 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023260061 0 0) 0x7fa15013e660 con 0x7fa15006d7b0 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1500a85f0 con 0x7fa15006d7b0 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341851306 0 0) 0x7fa1500704b0 con 0x7fa15006f710 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa15013e660 con 0x7fa15006f710 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2469191867 0 0) 0x7fa1380046e0 con 0x7fa150141670 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 >> v1:172.21.15.73:6790/0 conn(0x7fa15006d7b0 legacy=0x7fa15013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 >> v1:172.21.15.177:6789/0 conn(0x7fa15006f710 legacy=0x7fa150140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150070b50 con 0x7fa150141670 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa140001610 con 0x7fa150141670 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa1400018f0 con 0x7fa150141670 2024-09-16T14:41:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa14f7fe700 1 -- 172.21.15.73:0/349472014 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa140001c80 con 0x7fa150141670 2024-09-16T14:41:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 -- 172.21.15.73:0/349472014 >> v1:172.21.15.73:6789/0 conn(0x7fa150141670 legacy=0x7fa150148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:36.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 -- 172.21.15.73:0/349472014 shutdown_connections 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 -- 172.21.15.73:0/349472014 >> 172.21.15.73:0/349472014 conn(0x7fa15006a360 msgr2=0x7fa15006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 -- 172.21.15.73:0/349472014 shutdown_connections 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 -- 172.21.15.73:0/349472014 wait complete. 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 Processor -- start 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.968+0000 7fa155a33700 1 -- start start 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155a33700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1501ca520 con 0x7fa15006f710 2024-09-16T14:41:36.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155a33700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1501389b0 con 0x7fa15006d7b0 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155a33700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1501ca040 con 0x7fa150141670 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155232700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fa150141670 0x7fa1501caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:33932/0 (socket says 172.21.15.73:33932) 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155232700 1 -- 172.21.15.73:0/2010408186 learned_addr learned my addr 172.21.15.73:0/2010408186 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248178953 0 0) 0x7fa1501ca040 con 0x7fa150141670 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c0035d0 con 0x7fa150141670 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315621316 0 0) 0x7fa1501ca520 con 0x7fa15006f710 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1501ca040 con 0x7fa15006f710 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2306028777 0 0) 0x7fa13c0035d0 con 0x7fa150141670 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1501ca520 con 0x7fa150141670 2024-09-16T14:41:36.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa1400015d0 con 0x7fa150141670 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668469197 0 0) 0x7fa1501389b0 con 0x7fa15006d7b0 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa13c0035d0 con 0x7fa15006d7b0 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3604553642 0 0) 0x7fa1501ca040 con 0x7fa15006f710 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1501389b0 con 0x7fa15006f710 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa144001830 con 0x7fa15006f710 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 24528585 0 0) 0x7fa1501ca520 con 0x7fa150141670 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 >> v1:172.21.15.177:6789/0 conn(0x7fa15006d7b0 legacy=0x7fa1501d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 >> v1:172.21.15.73:6789/0 conn(0x7fa15006f710 legacy=0x7fa15013f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1501ca1d0 con 0x7fa150141670 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa150137e60 con 0x7fa150141670 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa140004b40 con 0x7fa150141670 2024-09-16T14:41:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fa140004ed0 con 0x7fa150141670 2024-09-16T14:41:36.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501e1f90 con 0x7fa150141670 2024-09-16T14:41:36.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500008d0 con 0x7fa150141670 2024-09-16T14:41:36.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.972+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fa14001a130 con 0x7fa150141670 2024-09-16T14:41:36.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.976+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fa14007f7c0 con 0x7fa150141670 2024-09-16T14:41:36.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:36.980+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fa14004cf10 con 0x7fa150141670 2024-09-16T14:41:37.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.152+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa15006fd40 con 0x7fa13c0673a0 2024-09-16T14:41:37.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa14d7fa700 1 -- 172.21.15.73:0/2010408186 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+153628 (unknown 2965378022 0 3879130293) 0x7fa148001a00 con 0x7fa13c0673a0 2024-09-16T14:41:37.173 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:41:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 >> v1:172.21.15.177:6816/2823028339 conn(0x7fa13c0673a0 legacy=0x7fa13c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 >> v1:172.21.15.73:6790/0 conn(0x7fa150141670 legacy=0x7fa1501caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 shutdown_connections 2024-09-16T14:41:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 >> 172.21.15.73:0/2010408186 conn(0x7fa15006a360 msgr2=0x7fa1501398f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 shutdown_connections 2024-09-16T14:41:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.168+0000 7fa155a33700 1 -- 172.21.15.73:0/2010408186 wait complete. 2024-09-16T14:41:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:41:37.188 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-16T14:41:36.310007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3549054267,"num_objects":878,"num_object_clones":0,"num_object_copies":1756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":2613,"num_read_kb":2608,"num_write":150894,"num_write_kb":5603087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152643,"ondisk_log_size":152643,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8861052,"kb_used_data":6623228,"kb_used_omap":12,"kb_used_meta":2237747,"kb_avail":746113668,"statfs":{"total":773094113280,"available":764020396032,"internally_reserved":0,"allocated":6782185472,"data_stored":6797229658,"data_compressed":70427572,"data_compressed_allocated":73408512,"data_compressed_original":93880320,"omap_allocated":12744,"internal_metadata":2291453496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.086895"},"pg_stats":[{"pgid":"3.1f","version":"22'4440","reported_seq":4489,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:32.330441+0000","last_change":"2024-09-16T14:37:24.064528+0000","last_active":"2024-09-16T14:39:32.330441+0000","last_peered":"2024-09-16T14:39:32.330441+0000","last_clean":"2024-09-16T14:39:32.330441+0000","last_became_active":"2024-09-16T14:37:24.063684+0000","last_became_peered":"2024-09-16T14:37:24.063684+0000","last_unstale":"2024-09-16T14:39:32.330441+0000","last_undegraded":"2024-09-16T14:39:32.330441+0000","last_fullsized":"2024-09-16T14:39:32.330441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:52:38.988733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137234784,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":140,"num_read_kb":116,"num_write":4501,"num_write_kb":200999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'6686","reported_seq":6706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:30.934252+0000","last_change":"2024-09-16T14:37:23.861741+0000","last_active":"2024-09-16T14:40:30.934252+0000","last_peered":"2024-09-16T14:40:30.934252+0000","last_clean":"2024-09-16T14:40:30.934252+0000","last_became_active":"2024-09-16T14:37:23.861295+0000","last_became_peered":"2024-09-16T14:37:23.861295+0000","last_unstale":"2024-09-16T14:40:30.934252+0000","last_undegraded":"2024-09-16T14:40:30.934252+0000","last_fullsized":"2024-09-16T14:40:30.934252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6686,"log_dups_size":0,"ondisk_log_size":6686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:53.405081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6680,"num_write_kb":211796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'6871","reported_seq":6897,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:39.797314+0000","last_change":"2024-09-16T14:37:23.875435+0000","last_active":"2024-09-16T14:40:39.797314+0000","last_peered":"2024-09-16T14:40:39.797314+0000","last_clean":"2024-09-16T14:40:39.797314+0000","last_became_active":"2024-09-16T14:37:23.875180+0000","last_became_peered":"2024-09-16T14:37:23.875180+0000","last_unstale":"2024-09-16T14:40:39.797314+0000","last_undegraded":"2024-09-16T14:40:39.797314+0000","last_fullsized":"2024-09-16T14:40:39.797314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6871,"log_dups_size":0,"ondisk_log_size":6871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:39.043377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":56,"num_read_kb":105,"num_write":6978,"num_write_kb":205252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"22'4530","reported_seq":4548,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:54.413706+0000","last_change":"2024-09-16T14:37:23.875704+0000","last_active":"2024-09-16T14:39:54.413706+0000","last_peered":"2024-09-16T14:39:54.413706+0000","last_clean":"2024-09-16T14:39:54.413706+0000","last_became_active":"2024-09-16T14:37:23.875445+0000","last_became_peered":"2024-09-16T14:37:23.875445+0000","last_unstale":"2024-09-16T14:39:54.413706+0000","last_undegraded":"2024-09-16T14:39:54.413706+0000","last_fullsized":"2024-09-16T14:39:54.413706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:02:46.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113247232,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4552,"num_write_kb":157847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'6411","reported_seq":6431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352107+0000","last_change":"2024-09-16T14:37:23.873790+0000","last_active":"2024-09-16T14:40:21.352107+0000","last_peered":"2024-09-16T14:40:21.352107+0000","last_clean":"2024-09-16T14:40:21.352107+0000","last_became_active":"2024-09-16T14:37:23.873310+0000","last_became_peered":"2024-09-16T14:37:23.873310+0000","last_unstale":"2024-09-16T14:40:21.352107+0000","last_undegraded":"2024-09-16T14:40:21.352107+0000","last_fullsized":"2024-09-16T14:40:21.352107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6411,"log_dups_size":0,"ondisk_log_size":6411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:17:02.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145360720,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":6379,"num_write_kb":204642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'6450","reported_seq":6464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:29.659585+0000","last_change":"2024-09-16T14:37:24.066877+0000","last_active":"2024-09-16T14:40:29.659585+0000","last_peered":"2024-09-16T14:40:29.659585+0000","last_clean":"2024-09-16T14:40:29.659585+0000","last_became_active":"2024-09-16T14:37:24.066152+0000","last_became_peered":"2024-09-16T14:37:24.066152+0000","last_unstale":"2024-09-16T14:40:29.659585+0000","last_undegraded":"2024-09-16T14:40:29.659585+0000","last_fullsized":"2024-09-16T14:40:29.659585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6450,"log_dups_size":0,"ondisk_log_size":6450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:44:02.871099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6431,"num_write_kb":206020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"23'4096","reported_seq":4108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352049+0000","last_change":"2024-09-16T14:37:23.874229+0000","last_active":"2024-09-16T14:40:21.352049+0000","last_peered":"2024-09-16T14:40:21.352049+0000","last_clean":"2024-09-16T14:40:21.352049+0000","last_became_active":"2024-09-16T14:37:23.873770+0000","last_became_peered":"2024-09-16T14:37:23.873770+0000","last_unstale":"2024-09-16T14:40:21.352049+0000","last_undegraded":"2024-09-16T14:40:21.352049+0000","last_fullsized":"2024-09-16T14:40:21.352049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:24.022900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4049,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"23'6120","reported_seq":6137,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:26.172770+0000","last_change":"2024-09-16T14:37:23.872533+0000","last_active":"2024-09-16T14:41:26.172770+0000","last_peered":"2024-09-16T14:41:26.172770+0000","last_clean":"2024-09-16T14:41:26.172770+0000","last_became_active":"2024-09-16T14:37:23.872035+0000","last_became_peered":"2024-09-16T14:37:23.872035+0000","last_unstale":"2024-09-16T14:41:26.172770+0000","last_undegraded":"2024-09-16T14:41:26.172770+0000","last_fullsized":"2024-09-16T14:41:26.172770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:54.842566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97783808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6122,"num_write_kb":160588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'5236","reported_seq":5554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:32.732562+0000","last_change":"2024-09-16T14:37:23.867566+0000","last_active":"2024-09-16T14:40:32.732562+0000","last_peered":"2024-09-16T14:40:32.732562+0000","last_clean":"2024-09-16T14:40:32.732562+0000","last_became_active":"2024-09-16T14:37:23.867197+0000","last_became_peered":"2024-09-16T14:37:23.867197+0000","last_unstale":"2024-09-16T14:40:32.732562+0000","last_undegraded":"2024-09-16T14:40:32.732562+0000","last_fullsized":"2024-09-16T14:40:32.732562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:03:22.246821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":1023,"num_read_kb":980,"num_write":5443,"num_write_kb":163369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"23'4373","reported_seq":4488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.262342+0000","last_change":"2024-09-16T14:37:23.867465+0000","last_active":"2024-09-16T14:40:21.262342+0000","last_peered":"2024-09-16T14:40:21.262342+0000","last_clean":"2024-09-16T14:40:21.262342+0000","last_became_active":"2024-09-16T14:37:23.866604+0000","last_became_peered":"2024-09-16T14:37:23.866604+0000","last_unstale":"2024-09-16T14:40:21.262342+0000","last_undegraded":"2024-09-16T14:40:21.262342+0000","last_fullsized":"2024-09-16T14:40:21.262342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4373,"log_dups_size":0,"ondisk_log_size":4373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:53:37.384963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109183504,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":4368,"num_write_kb":166111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'6921","reported_seq":6938,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:41.947670+0000","last_change":"2024-09-16T14:37:23.871305+0000","last_active":"2024-09-16T14:40:41.947670+0000","last_peered":"2024-09-16T14:40:41.947670+0000","last_clean":"2024-09-16T14:40:41.947670+0000","last_became_active":"2024-09-16T14:37:23.871022+0000","last_became_peered":"2024-09-16T14:37:23.871022+0000","last_unstale":"2024-09-16T14:40:41.947670+0000","last_undegraded":"2024-09-16T14:40:41.947670+0000","last_fullsized":"2024-09-16T14:40:41.947670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6921,"log_dups_size":0,"ondisk_log_size":6921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:41.652894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111198208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6926,"num_write_kb":195181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'5443","reported_seq":5460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:33.939569+0000","last_change":"2024-09-16T14:37:23.866707+0000","last_active":"2024-09-16T14:40:33.939569+0000","last_peered":"2024-09-16T14:40:33.939569+0000","last_clean":"2024-09-16T14:40:33.939569+0000","last_became_active":"2024-09-16T14:37:23.866386+0000","last_became_peered":"2024-09-16T14:37:23.866386+0000","last_unstale":"2024-09-16T14:40:33.939569+0000","last_undegraded":"2024-09-16T14:40:33.939569+0000","last_fullsized":"2024-09-16T14:40:33.939569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5443,"log_dups_size":0,"ondisk_log_size":5443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:25:47.217293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":5404,"num_write_kb":164450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:27.462965+0000","last_change":"2024-09-16T14:37:18.312221+0000","last_active":"2024-09-16T14:39:27.462965+0000","last_peered":"2024-09-16T14:39:27.462965+0000","last_clean":"2024-09-16T14:39:27.462965+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:39:27.462965+0000","last_undegraded":"2024-09-16T14:39:27.462965+0000","last_fullsized":"2024-09-16T14:39:27.462965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:52.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'4800","reported_seq":4812,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:39.278658+0000","last_change":"2024-09-16T14:37:23.875261+0000","last_active":"2024-09-16T14:40:39.278658+0000","last_peered":"2024-09-16T14:40:39.278658+0000","last_clean":"2024-09-16T14:40:39.278658+0000","last_became_active":"2024-09-16T14:37:23.874796+0000","last_became_peered":"2024-09-16T14:37:23.874796+0000","last_unstale":"2024-09-16T14:40:39.278658+0000","last_undegraded":"2024-09-16T14:40:39.278658+0000","last_fullsized":"2024-09-16T14:40:39.278658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:55.078935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4775,"num_write_kb":162435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:27.321670+0000","last_change":"2024-09-16T14:37:18.305901+0000","last_active":"2024-09-16T14:39:27.321670+0000","last_peered":"2024-09-16T14:39:27.321670+0000","last_clean":"2024-09-16T14:39:27.321670+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:39:27.321670+0000","last_undegraded":"2024-09-16T14:39:27.321670+0000","last_fullsized":"2024-09-16T14:39:27.321670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:15:04.908893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'3458","reported_seq":3470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.345082+0000","last_change":"2024-09-16T14:37:23.875452+0000","last_active":"2024-09-16T14:40:21.345082+0000","last_peered":"2024-09-16T14:40:21.345082+0000","last_clean":"2024-09-16T14:40:21.345082+0000","last_became_active":"2024-09-16T14:37:23.874901+0000","last_became_peered":"2024-09-16T14:37:23.874901+0000","last_unstale":"2024-09-16T14:40:21.345082+0000","last_undegraded":"2024-09-16T14:40:21.345082+0000","last_fullsized":"2024-09-16T14:40:21.345082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:21.907518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3408,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.951486+0000","last_change":"2024-09-16T14:37:18.311955+0000","last_active":"2024-09-16T14:40:20.951486+0000","last_peered":"2024-09-16T14:40:20.951486+0000","last_clean":"2024-09-16T14:40:20.951486+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:40:20.951486+0000","last_undegraded":"2024-09-16T14:40:20.951486+0000","last_fullsized":"2024-09-16T14:40:20.951486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:15.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'5596","reported_seq":5626,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:34.713566+0000","last_change":"2024-09-16T14:37:23.871434+0000","last_active":"2024-09-16T14:40:34.713566+0000","last_peered":"2024-09-16T14:40:34.713566+0000","last_clean":"2024-09-16T14:40:34.713566+0000","last_became_active":"2024-09-16T14:37:23.871068+0000","last_became_peered":"2024-09-16T14:37:23.871068+0000","last_unstale":"2024-09-16T14:40:34.713566+0000","last_undegraded":"2024-09-16T14:40:34.713566+0000","last_fullsized":"2024-09-16T14:40:34.713566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5596,"log_dups_size":0,"ondisk_log_size":5596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:26:03.808662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":5614,"num_write_kb":199780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.943175+0000","last_change":"2024-09-16T14:37:18.445088+0000","last_active":"2024-09-16T14:40:20.943175+0000","last_peered":"2024-09-16T14:40:20.943175+0000","last_clean":"2024-09-16T14:40:20.943175+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:40:20.943175+0000","last_undegraded":"2024-09-16T14:40:20.943175+0000","last_fullsized":"2024-09-16T14:40:20.943175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:26:02.071763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'4153","reported_seq":4175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.961936+0000","last_change":"2024-09-16T14:37:23.871756+0000","last_active":"2024-09-16T14:40:20.961936+0000","last_peered":"2024-09-16T14:40:20.961936+0000","last_clean":"2024-09-16T14:40:20.961936+0000","last_became_active":"2024-09-16T14:37:23.871465+0000","last_became_peered":"2024-09-16T14:37:23.871465+0000","last_unstale":"2024-09-16T14:40:20.961936+0000","last_undegraded":"2024-09-16T14:40:20.961936+0000","last_fullsized":"2024-09-16T14:40:20.961936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4153,"log_dups_size":0,"ondisk_log_size":4153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:48:14.130571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":4172,"num_write_kb":171144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"22'3334","reported_seq":3370,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.986137+0000","last_change":"2024-09-16T14:37:23.872581+0000","last_active":"2024-09-16T14:40:20.986137+0000","last_peered":"2024-09-16T14:40:20.986137+0000","last_clean":"2024-09-16T14:40:20.986137+0000","last_became_active":"2024-09-16T14:37:23.872385+0000","last_became_peered":"2024-09-16T14:37:23.872385+0000","last_unstale":"2024-09-16T14:40:20.986137+0000","last_undegraded":"2024-09-16T14:40:20.986137+0000","last_fullsized":"2024-09-16T14:40:20.986137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3334,"log_dups_size":0,"ondisk_log_size":3334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:05:22.498912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96731664,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":85,"num_read_kb":129,"num_write":3384,"num_write_kb":160971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950914+0000","last_change":"2024-09-16T14:37:18.311825+0000","last_active":"2024-09-16T14:40:20.950914+0000","last_peered":"2024-09-16T14:40:20.950914+0000","last_clean":"2024-09-16T14:40:20.950914+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:40:20.950914+0000","last_undegraded":"2024-09-16T14:40:20.950914+0000","last_fullsized":"2024-09-16T14:40:20.950914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:34.098272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"23'3338","reported_seq":3359,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.350199+0000","last_change":"2024-09-16T14:37:23.875984+0000","last_active":"2024-09-16T14:40:21.350199+0000","last_peered":"2024-09-16T14:40:21.350199+0000","last_clean":"2024-09-16T14:40:21.350199+0000","last_became_active":"2024-09-16T14:37:23.874911+0000","last_became_peered":"2024-09-16T14:37:23.874911+0000","last_unstale":"2024-09-16T14:40:21.350199+0000","last_undegraded":"2024-09-16T14:40:21.350199+0000","last_fullsized":"2024-09-16T14:40:21.350199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3338,"log_dups_size":0,"ondisk_log_size":3338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3305,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.008141+0000","last_change":"2024-09-16T14:37:18.446072+0000","last_active":"2024-09-16T14:40:21.008141+0000","last_peered":"2024-09-16T14:40:21.008141+0000","last_clean":"2024-09-16T14:40:21.008141+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:40:21.008141+0000","last_undegraded":"2024-09-16T14:40:21.008141+0000","last_fullsized":"2024-09-16T14:40:21.008141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:00:52.557322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'4079","reported_seq":4092,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352467+0000","last_change":"2024-09-16T14:37:23.876205+0000","last_active":"2024-09-16T14:40:21.352467+0000","last_peered":"2024-09-16T14:40:21.352467+0000","last_clean":"2024-09-16T14:40:21.352467+0000","last_became_active":"2024-09-16T14:37:23.875930+0000","last_became_peered":"2024-09-16T14:37:23.875930+0000","last_unstale":"2024-09-16T14:40:21.352467+0000","last_undegraded":"2024-09-16T14:40:21.352467+0000","last_fullsized":"2024-09-16T14:40:21.352467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:02.546999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":169350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950618+0000","last_change":"2024-09-16T14:37:18.310876+0000","last_active":"2024-09-16T14:40:20.950618+0000","last_peered":"2024-09-16T14:40:20.950618+0000","last_clean":"2024-09-16T14:40:20.950618+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:40:20.950618+0000","last_undegraded":"2024-09-16T14:40:20.950618+0000","last_fullsized":"2024-09-16T14:40:20.950618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:54.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'4606","reported_seq":4622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:40.923348+0000","last_change":"2024-09-16T14:37:23.873479+0000","last_active":"2024-09-16T14:40:40.923348+0000","last_peered":"2024-09-16T14:40:40.923348+0000","last_clean":"2024-09-16T14:40:40.923348+0000","last_became_active":"2024-09-16T14:37:23.873060+0000","last_became_peered":"2024-09-16T14:37:23.873060+0000","last_unstale":"2024-09-16T14:40:40.923348+0000","last_undegraded":"2024-09-16T14:40:40.923348+0000","last_fullsized":"2024-09-16T14:40:40.923348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:09:28.912309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96536232,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12,"num_read_kb":135,"num_write":4615,"num_write_kb":187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950893+0000","last_change":"2024-09-16T14:37:18.312343+0000","last_active":"2024-09-16T14:40:20.950893+0000","last_peered":"2024-09-16T14:40:20.950893+0000","last_clean":"2024-09-16T14:40:20.950893+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:40:20.950893+0000","last_undegraded":"2024-09-16T14:40:20.950893+0000","last_fullsized":"2024-09-16T14:40:20.950893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:47:21.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.938773+0000","last_change":"2024-09-16T14:37:15.105418+0000","last_active":"2024-09-16T14:40:20.938773+0000","last_peered":"2024-09-16T14:40:20.938773+0000","last_clean":"2024-09-16T14:40:20.938773+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:40:20.938773+0000","last_undegraded":"2024-09-16T14:40:20.938773+0000","last_fullsized":"2024-09-16T14:40:20.938773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_clean_scrub_stamp":"2024-09-16T14:37:13.233269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:11.758633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3701","reported_seq":3719,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.349658+0000","last_change":"2024-09-16T14:37:23.875363+0000","last_active":"2024-09-16T14:40:21.349658+0000","last_peered":"2024-09-16T14:40:21.349658+0000","last_clean":"2024-09-16T14:40:21.349658+0000","last_became_active":"2024-09-16T14:37:23.874809+0000","last_became_peered":"2024-09-16T14:37:23.874809+0000","last_unstale":"2024-09-16T14:40:21.349658+0000","last_undegraded":"2024-09-16T14:40:21.349658+0000","last_fullsized":"2024-09-16T14:40:21.349658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3701,"log_dups_size":0,"ondisk_log_size":3701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:04.524885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88155160,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":3655,"num_write_kb":140764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"23'8761","reported_seq":8887,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:37.142608+0000","last_change":"2024-09-16T14:37:23.871280+0000","last_active":"2024-09-16T14:40:37.142608+0000","last_peered":"2024-09-16T14:40:37.142608+0000","last_clean":"2024-09-16T14:40:37.142608+0000","last_became_active":"2024-09-16T14:37:23.870990+0000","last_became_peered":"2024-09-16T14:37:23.870990+0000","last_unstale":"2024-09-16T14:40:37.142608+0000","last_undegraded":"2024-09-16T14:40:37.142608+0000","last_fullsized":"2024-09-16T14:40:37.142608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":8761,"log_dups_size":0,"ondisk_log_size":8761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:35:00.974485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":391,"num_read_kb":344,"num_write":6745,"num_write_kb":203146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'4583","reported_seq":4595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.264394+0000","last_change":"2024-09-16T14:37:23.864603+0000","last_active":"2024-09-16T14:40:21.264394+0000","last_peered":"2024-09-16T14:40:21.264394+0000","last_clean":"2024-09-16T14:40:21.264394+0000","last_became_active":"2024-09-16T14:37:23.864034+0000","last_became_peered":"2024-09-16T14:37:23.864034+0000","last_unstale":"2024-09-16T14:40:21.264394+0000","last_undegraded":"2024-09-16T14:40:21.264394+0000","last_fullsized":"2024-09-16T14:40:21.264394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:21.046157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4557,"num_write_kb":210052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"22'3924","reported_seq":3936,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:42.284830+0000","last_change":"2024-09-16T14:37:23.874896+0000","last_active":"2024-09-16T14:39:42.284830+0000","last_peered":"2024-09-16T14:39:42.284830+0000","last_clean":"2024-09-16T14:39:42.284830+0000","last_became_active":"2024-09-16T14:37:23.874573+0000","last_became_peered":"2024-09-16T14:37:23.874573+0000","last_unstale":"2024-09-16T14:39:42.284830+0000","last_undegraded":"2024-09-16T14:39:42.284830+0000","last_fullsized":"2024-09-16T14:39:42.284830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:27.278143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":193410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"23'2810","reported_seq":2822,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.340738+0000","last_change":"2024-09-16T14:37:23.874358+0000","last_active":"2024-09-16T14:40:21.340738+0000","last_peered":"2024-09-16T14:40:21.340738+0000","last_clean":"2024-09-16T14:40:21.340738+0000","last_became_active":"2024-09-16T14:37:23.874099+0000","last_became_peered":"2024-09-16T14:37:23.874099+0000","last_unstale":"2024-09-16T14:40:21.340738+0000","last_undegraded":"2024-09-16T14:40:21.340738+0000","last_fullsized":"2024-09-16T14:40:21.340738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:21.931138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78251856,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":122330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"23'3967","reported_seq":3990,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.258399+0000","last_change":"2024-09-16T14:37:23.865919+0000","last_active":"2024-09-16T14:40:21.258399+0000","last_peered":"2024-09-16T14:40:21.258399+0000","last_clean":"2024-09-16T14:40:21.258399+0000","last_became_active":"2024-09-16T14:37:23.865656+0000","last_became_peered":"2024-09-16T14:37:23.865656+0000","last_unstale":"2024-09-16T14:40:21.258399+0000","last_undegraded":"2024-09-16T14:40:21.258399+0000","last_fullsized":"2024-09-16T14:40:21.258399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:55:33.716535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":36,"num_write":3967,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'4553","reported_seq":4651,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.404323+0000","last_change":"2024-09-16T14:37:23.869225+0000","last_active":"2024-09-16T14:40:21.404323+0000","last_peered":"2024-09-16T14:40:21.404323+0000","last_clean":"2024-09-16T14:40:21.404323+0000","last_became_active":"2024-09-16T14:37:23.868935+0000","last_became_peered":"2024-09-16T14:37:23.868935+0000","last_unstale":"2024-09-16T14:40:21.404323+0000","last_undegraded":"2024-09-16T14:40:21.404323+0000","last_fullsized":"2024-09-16T14:40:21.404323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4553,"log_dups_size":0,"ondisk_log_size":4553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:40:51.366518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100082712,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":335,"num_read_kb":258,"num_write":4833,"num_write_kb":173375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'2696","reported_seq":2710,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.345360+0000","last_change":"2024-09-16T14:37:23.868668+0000","last_active":"2024-09-16T14:40:21.345360+0000","last_peered":"2024-09-16T14:40:21.345360+0000","last_clean":"2024-09-16T14:40:21.345360+0000","last_became_active":"2024-09-16T14:37:23.868262+0000","last_became_peered":"2024-09-16T14:37:23.868262+0000","last_unstale":"2024-09-16T14:40:21.345360+0000","last_undegraded":"2024-09-16T14:40:21.345360+0000","last_fullsized":"2024-09-16T14:40:21.345360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2696,"log_dups_size":0,"ondisk_log_size":2696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:42.842709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79823376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2657,"num_write_kb":119691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'3787","reported_seq":3805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.349906+0000","last_change":"2024-09-16T14:37:24.066472+0000","last_active":"2024-09-16T14:40:21.349906+0000","last_peered":"2024-09-16T14:40:21.349906+0000","last_clean":"2024-09-16T14:40:21.349906+0000","last_became_active":"2024-09-16T14:37:24.065966+0000","last_became_peered":"2024-09-16T14:37:24.065966+0000","last_unstale":"2024-09-16T14:40:21.349906+0000","last_undegraded":"2024-09-16T14:40:21.349906+0000","last_fullsized":"2024-09-16T14:40:21.349906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:16:40.228633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":3750,"num_write_kb":213570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"22'2640","reported_seq":2652,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:47.468331+0000","last_change":"2024-09-16T14:37:23.866814+0000","last_active":"2024-09-16T14:39:47.468331+0000","last_peered":"2024-09-16T14:39:47.468331+0000","last_clean":"2024-09-16T14:39:47.468331+0000","last_became_active":"2024-09-16T14:37:23.866545+0000","last_became_peered":"2024-09-16T14:37:23.866545+0000","last_unstale":"2024-09-16T14:39:47.468331+0000","last_undegraded":"2024-09-16T14:39:47.468331+0000","last_fullsized":"2024-09-16T14:39:47.468331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:50.661424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":119555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"23'2403","reported_seq":2415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.346081+0000","last_change":"2024-09-16T14:37:23.873436+0000","last_active":"2024-09-16T14:40:21.346081+0000","last_peered":"2024-09-16T14:40:21.346081+0000","last_clean":"2024-09-16T14:40:21.346081+0000","last_became_active":"2024-09-16T14:37:23.873069+0000","last_became_peered":"2024-09-16T14:37:23.873069+0000","last_unstale":"2024-09-16T14:40:21.346081+0000","last_undegraded":"2024-09-16T14:40:21.346081+0000","last_fullsized":"2024-09-16T14:40:21.346081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2403,"log_dups_size":0,"ondisk_log_size":2403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:22:12.516441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88145920,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2351,"num_write_kb":101825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"23'7757","reported_seq":7771,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:37.293224+0000","last_change":"2024-09-16T14:37:23.868786+0000","last_active":"2024-09-16T14:40:37.293224+0000","last_peered":"2024-09-16T14:40:37.293224+0000","last_clean":"2024-09-16T14:40:37.293224+0000","last_became_active":"2024-09-16T14:37:23.868469+0000","last_became_peered":"2024-09-16T14:37:23.868469+0000","last_unstale":"2024-09-16T14:40:37.293224+0000","last_undegraded":"2024-09-16T14:40:37.293224+0000","last_fullsized":"2024-09-16T14:40:37.293224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":7757,"log_dups_size":0,"ondisk_log_size":7757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:49:15.825301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":7743,"num_write_kb":271203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3548463880,"num_objects":874,"num_object_clones":0,"num_object_copies":1748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":874,"num_whiteouts":0,"num_read":2497,"num_read_kb":2508,"num_write":150733,"num_write_kb":5600669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6780321792,"data_stored":6795577496,"data_compressed":70367536,"data_compressed_allocated":73326592,"data_compressed_original":92856320,"omap_allocated":0,"internal_metadata":0},"log_size":152523,"ondisk_log_size":152523,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542199,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1039852,"kb_used_data":778276,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93331988,"statfs":{"total":96636764160,"available":95571955712,"internally_reserved":0,"allocated":796954624,"data_stored":799453754,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.68100000000000005},"min":{"1min":0.40200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.3660000000000001,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94899999999999995,"15min":1.0940000000000001},"min":{"1min":0.503,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1519999999999999,"5min":10.654999999999999,"15min":10.654999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70799999999999996,"15min":0.65300000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.522,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0700000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.745,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.86899999999999999,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0960000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.294}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.365,"15min":1.3280000000000001},"min":{"1min":0.45400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.571,"5min":28.141999999999999,"15min":28.141999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.0800000000000001,"15min":0.81799999999999995},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.069,"5min":28.109999999999999,"15min":28.109999999999999},"last":1.113}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90000000000000002,"15min":0.91800000000000004},"min":{"1min":0.41599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.208,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.876},"min":{"1min":0.434,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.256,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.321}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.202,"15min":1.46},"min":{"1min":0.66700000000000004,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1719999999999999,"5min":14.289,"15min":14.289},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.92100000000000004},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.4710000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.431}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96799999999999997,"15min":0.91300000000000003},"min":{"1min":0.57299999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6279999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.387},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.95199999999999996,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2949999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.3480000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1148008,"kb_used_data":850336,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93223832,"statfs":{"total":96636764160,"available":95461203968,"internally_reserved":0,"allocated":870744064,"data_stored":872709495,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.496},"min":{"1min":0.251,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.84199999999999997,"5min":1.857,"15min":1.857},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.84399999999999997,"15min":1.0529999999999999},"min":{"1min":0.255,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.92700000000000005,"5min":12.141,"15min":12.141},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.318,"5min":0.224,"15min":0.224},"max":{"1min":1.1830000000000001,"5min":1.657,"15min":1.657},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.224,"15min":0.224},"max":{"1min":0.86199999999999999,"5min":1.077,"15min":1.077},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.147,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0600000000000001,"15min":0.997},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3009999999999999,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":1.0940000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.343,"5min":1.786,"15min":1.786},"last":1.04},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.95799999999999996,"15min":0.86399999999999999},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.1849999999999996,"5min":5.7869999999999999,"15min":5.7869999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4370000000000001,"5min":1.968,"15min":1.968},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":0.94599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.389,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.073}]},{"osd":7,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.323,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.179},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.89700000000000002},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3089999999999999,"5min":1.7,"15min":1.7},"last":0.96799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191456,"kb_used_data":935640,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93180384,"statfs":{"total":96636764160,"available":95416713216,"internally_reserved":0,"allocated":958095360,"data_stored":959421543,"data_compressed":13128965,"data_compressed_allocated":13701120,"data_compressed_original":15773696,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.70299999999999996,"15min":0.79800000000000004},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":1.181,"5min":3.02,"15min":3.02},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71799999999999997,"15min":0.80200000000000005},"min":{"1min":0.26400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":1.0920000000000001,"5min":3.141,"15min":3.141},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.82199999999999995,"15min":1.0369999999999999},"min":{"1min":0.217,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.96899999999999997,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.747},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.873,"15min":1.0580000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.202,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.427,"15min":1.383},"min":{"1min":0.32400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.82299999999999995,"5min":48.195,"15min":48.195},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.748,"5min":1.4379999999999999,"15min":2.069},"min":{"1min":0.31,"5min":0.246,"15min":0.246},"max":{"1min":1.2609999999999999,"5min":25.248000000000001,"15min":25.248000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3759999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.111},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91400000000000003,"15min":0.88600000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.544,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.337}]},{"osd":5,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.024,"15min":1.1120000000000001},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.206,"5min":5.819,"15min":5.819},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88,"15min":0.83199999999999996},"min":{"1min":0.59499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.371,"5min":1.611,"15min":1.611},"last":1.212}]},{"osd":6,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.94699999999999995},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6479999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.59399999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3620000000000001,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":1.3029999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.466,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":0.875},"min":{"1min":0.51300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3240000000000001,"5min":1.544,"15min":1.544},"last":1.1899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255284,"kb_used_data":921516,"kb_used_omap":1,"kb_used_meta":333758,"kb_avail":93116556,"statfs":{"total":96636764160,"available":95351353344,"internally_reserved":0,"allocated":943632384,"data_stored":944639351,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":1594,"internal_metadata":341768646},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.73299999999999998},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.88700000000000001,"5min":4.9779999999999998,"15min":4.9779999999999998},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91300000000000003,"5min":5.0839999999999996,"15min":5.0839999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.96699999999999997,"15min":1.149},"min":{"1min":0.307,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0449999999999999,"5min":7.6040000000000001,"15min":7.6040000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.262,"15min":1.8340000000000001},"min":{"1min":0.28100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":17.472000000000001,"15min":17.472000000000001},"last":0.996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.78200000000000003},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.254},"max":{"1min":1.073,"5min":3.9649999999999999,"15min":3.9649999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.82799999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.224,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.091},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.115}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.1739999999999999,"15min":1.423},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4239999999999999,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.998,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":5.9429999999999996,"15min":5.9429999999999996},"last":1.2430000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95199999999999996,"15min":0.92000000000000004},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3300000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.034},{"interface":"front","average":{"1min":1.022,"5min":1.173,"15min":1.363},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.4970000000000001,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":1.218}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0880000000000001,"15min":1.1759999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.528,"5min":7.5819999999999999,"15min":7.5819999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.079},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4870000000000001,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":1.1619999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":531216,"kb_used_data":432008,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93840624,"statfs":{"total":96636764160,"available":96092798976,"internally_reserved":0,"allocated":442376192,"data_stored":444217283,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":1589,"internal_metadata":101579211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.1639999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.85399999999999998,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1180000000000001,"5min":8.6959999999999997,"15min":8.6959999999999997},"last":0.88900000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76000000000000001,"15min":0.67700000000000005},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.907,"15min":1.907},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78600000000000003,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.999,"5min":5.798,"15min":5.798},"last":1.022}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.78600000000000003},"min":{"1min":0.56200000000000006,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.169,"5min":4.109,"15min":4.109},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.327,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.1679999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.498,"15min":1.98},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":24.472000000000001,"15min":24.472000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0740000000000001,"15min":1.258},"min":{"1min":0.55300000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1240000000000001,"5min":6.6139999999999999,"15min":6.6139999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82699999999999996,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.29,"5min":1.377,"15min":1.377},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.77000000000000002},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.413,"5min":1.581,"15min":1.581},"last":1.0740000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.83399999999999996},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.339,"5min":1.712,"15min":1.712},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.93000000000000005,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2010000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.008,"15min":0.93999999999999995},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.05},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.248,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.137}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1226112,"kb_used_data":880056,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93145728,"statfs":{"total":96636764160,"available":95381225472,"internally_reserved":0,"allocated":901177344,"data_stored":902461087,"data_compressed":6836315,"data_compressed_allocated":7131136,"data_compressed_original":9027584,"omap_allocated":1594,"internal_metadata":354351558},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.68400000000000005},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.153,"5min":6.4800000000000004,"15min":6.4800000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.81799999999999995},"min":{"1min":0.48599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1020000000000001,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":1.071}]},{"osd":1,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.96399999999999997,"15min":1.034},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.046,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":1.0329999999999999},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82899999999999996,"15min":0.78100000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1910000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.177}]},{"osd":3,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84599999999999997},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.244,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.151},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2250000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.2190000000000001}]},{"osd":4,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.145,"5min":1.319,"15min":1.319},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":4.2720000000000002,"15min":7.6070000000000002},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.399,"5min":91.039000000000001,"15min":91.039000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.038},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99199999999999999,"15min":0.94899999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.006,"15min":0.94299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.337,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1000000000000001,"15min":1.024},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.593,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.246}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":985580,"kb_used_data":729764,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93386260,"statfs":{"total":96636764160,"available":95627530240,"internally_reserved":0,"allocated":747278336,"data_stored":750294603,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.82599999999999996,"15min":0.93799999999999994},"min":{"1min":0.38600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.097,"5min":4.617,"15min":4.617},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66900000000000004,"15min":0.623},"min":{"1min":0.32800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.94499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3520000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.95099999999999996,"15min":1.117},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.212,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":1.0620000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.40899999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":2.528,"15min":2.528},"last":1.103},{"interface":"front","average":{"1min":0.872,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.4530000000000001,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.879,"15min":0.871},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.45000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.278,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1259999999999999}]},{"osd":5,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1559999999999999,"5min":2.726,"15min":2.726},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.55500000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.2689999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.633,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4330000000000001,"5min":1.782,"15min":1.782},"last":1.198}]},{"osd":7,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.49099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.131,"5min":4.556,"15min":4.556},"last":1.153},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0169999999999999,"15min":0.93600000000000005},"min":{"1min":0.5,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3120000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483544,"kb_used_data":1095632,"kb_used_omap":1,"kb_used_meta":387902,"kb_avail":92888296,"statfs":{"total":96636764160,"available":95117615104,"internally_reserved":0,"allocated":1121927168,"data_stored":1124032542,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":1592,"internal_metadata":397212104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.621},"min":{"1min":0.27900000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.84099999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":1.0269999999999999},"min":{"1min":0.34499999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.004,"5min":12.147,"15min":12.147},"last":0.73899999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.28,"5min":1.718,"15min":1.718},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":0.63400000000000001},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77900000000000003,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.67900000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.85299999999999998},"min":{"1min":0.39300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.95299999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0920000000000001,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.78300000000000003}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.5389999999999999,"15min":2.1070000000000002},"min":{"1min":0.433,"5min":0.309,"15min":0.309},"max":{"1min":1.482,"5min":29.449000000000002,"15min":29.449000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.161,"5min":8.4499999999999993,"15min":8.4499999999999993},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.1479999999999999,"15min":1.042},"min":{"1min":0.432,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":11.983000000000001,"5min":11.983000000000001,"15min":11.983000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.242,"15min":1.5740000000000001},"min":{"1min":0.5,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.22,"5min":13.377000000000001,"15min":13.377000000000001},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.161,"15min":1.337},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":13.334,"15min":13.334},"last":1.103},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.569,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1499999999999999,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.7050000000000001,"5min":8.6829999999999998,"15min":8.6829999999999998},"last":1.23},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2010000000000001,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.0070000000000001,"5min":8.7050000000000001,"15min":8.7050000000000001},"last":1.268}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":943415296,"data_stored":944564948,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":957816832,"data_stored":958818212,"data_compressed":13098947,"data_compressed_allocated":13660160,"data_compressed_original":15261696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":870526976,"data_stored":872635092,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1121705984,"data_stored":1123958120,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":747061248,"data_stored":750220200,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":900898816,"data_stored":901857756,"data_compressed":6806297,"data_compressed_allocated":7090176,"data_compressed_original":8515584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":796737536,"data_stored":799380288,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":442159104,"data_stored":444142880,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:41:37.192 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:41:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8dec3d7700 1 Processor -- start 2024-09-16T14:41:37.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8dec3d7700 1 -- start start 2024-09-16T14:41:37.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8dec3d7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de406fe70 con 0x7f8de413d840 2024-09-16T14:41:37.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8dec3d7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de413f2d0 con 0x7f8de4073ba0 2024-09-16T14:41:37.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8dec3d7700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de4073f80 con 0x7f8de413dc90 2024-09-16T14:41:37.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8de9972700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8de413d840 0x7f8de4070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40876/0 (socket says 172.21.15.73:40876) 2024-09-16T14:41:37.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8de9972700 1 -- 172.21.15.73:0/2971328037 learned_addr learned my addr 172.21.15.73:0/2971328037 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209608067 0 0) 0x7f8de406fe70 con 0x7f8de413d840 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd00035d0 con 0x7f8de413d840 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.300+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112694205 0 0) 0x7f8de4073f80 con 0x7f8de413dc90 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de406fe70 con 0x7f8de413dc90 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107745107 0 0) 0x7f8dd00035d0 con 0x7f8de413d840 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 >> v1:172.21.15.73:6790/0 conn(0x7f8de413dc90 legacy=0x7f8de4149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 >> v1:172.21.15.177:6789/0 conn(0x7f8de4073ba0 legacy=0x7f8de413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40711d0 con 0x7f8de413d840 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8dd4001610 con 0x7f8de413d840 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8dd4001830 con 0x7f8de413d840 2024-09-16T14:41:37.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8de9171700 1 -- 172.21.15.73:0/2971328037 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8dd4001bc0 con 0x7f8de413d840 2024-09-16T14:41:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 -- 172.21.15.73:0/2971328037 >> v1:172.21.15.73:6789/0 conn(0x7f8de413d840 legacy=0x7f8de4070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 -- 172.21.15.73:0/2971328037 shutdown_connections 2024-09-16T14:41:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 -- 172.21.15.73:0/2971328037 >> 172.21.15.73:0/2971328037 conn(0x7f8de40b3810 msgr2=0x7f8de40b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 -- 172.21.15.73:0/2971328037 shutdown_connections 2024-09-16T14:41:37.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 -- 172.21.15.73:0/2971328037 wait complete. 2024-09-16T14:41:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 Processor -- start 2024-09-16T14:41:37.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.304+0000 7f8dec3d7700 1 -- start start 2024-09-16T14:41:37.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dec3d7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de41d82e0 con 0x7f8de4073ba0 2024-09-16T14:41:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dec3d7700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40ad260 con 0x7f8de413d840 2024-09-16T14:41:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dec3d7700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40accd0 con 0x7f8de413dc90 2024-09-16T14:41:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dea173700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8de4073ba0 0x7f8de41d74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40884/0 (socket says 172.21.15.73:40884) 2024-09-16T14:41:37.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dea173700 1 -- 172.21.15.73:0/452879998 learned_addr learned my addr 172.21.15.73:0/452879998 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:37.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834405514 0 0) 0x7f8de41d82e0 con 0x7f8de4073ba0 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc80035d0 con 0x7f8de4073ba0 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442882980 0 0) 0x7f8de40accd0 con 0x7f8de413dc90 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de41d82e0 con 0x7f8de413dc90 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438418919 0 0) 0x7f8de40ad260 con 0x7f8de413d840 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de40accd0 con 0x7f8de413d840 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3139982772 0 0) 0x7f8dc80035d0 con 0x7f8de4073ba0 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8de40ad260 con 0x7f8de4073ba0 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8de00019e0 con 0x7f8de4073ba0 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1619544069 0 0) 0x7f8de41d82e0 con 0x7f8de413dc90 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8dc80035d0 con 0x7f8de413dc90 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8ddc001ad0 con 0x7f8de413dc90 2024-09-16T14:41:37.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1179184241 0 0) 0x7f8de40ad260 con 0x7f8de4073ba0 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 >> v1:172.21.15.73:6790/0 conn(0x7f8de413dc90 legacy=0x7f8de41dea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 >> v1:172.21.15.177:6789/0 conn(0x7f8de413d840 legacy=0x7f8de41d7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40ace60 con 0x7f8de4073ba0 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de40ac630 con 0x7f8de4073ba0 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8de0003970 con 0x7f8de4073ba0 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8de0003d00 con 0x7f8de4073ba0 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de411b3f0 con 0x7f8de4073ba0 2024-09-16T14:41:37.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.308+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de413c050 con 0x7f8de4073ba0 2024-09-16T14:41:37.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.312+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f8de0003f70 con 0x7f8de4073ba0 2024-09-16T14:41:37.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.312+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f8de007f8a0 con 0x7f8de4073ba0 2024-09-16T14:41:37.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.316+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f8de004ceb0 con 0x7f8de4073ba0 2024-09-16T14:41:37.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.488+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8de40b0110 con 0x7f8dc80671b0 2024-09-16T14:41:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.500+0000 7f8ddaffd700 1 -- 172.21.15.73:0/452879998 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+153628 (unknown 2965378022 0 3317296479) 0x7f8dd40078c0 con 0x7f8dc80671b0 2024-09-16T14:41:37.509 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:41:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.504+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 >> v1:172.21.15.177:6816/2823028339 conn(0x7f8dc80671b0 legacy=0x7f8dc8069670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.504+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 >> v1:172.21.15.73:6789/0 conn(0x7f8de4073ba0 legacy=0x7f8de41d74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.504+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 shutdown_connections 2024-09-16T14:41:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.504+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 >> 172.21.15.73:0/452879998 conn(0x7f8de40b3810 msgr2=0x7f8de40709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.504+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 shutdown_connections 2024-09-16T14:41:37.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.504+0000 7f8dec3d7700 1 -- 172.21.15.73:0/452879998 wait complete. 2024-09-16T14:41:37.512 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:41:37.525 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-16T14:41:37.227179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3549054267,"num_objects":878,"num_object_clones":0,"num_object_copies":1756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":2613,"num_read_kb":2608,"num_write":150894,"num_write_kb":5603087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152643,"ondisk_log_size":152643,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8861052,"kb_used_data":6623228,"kb_used_omap":12,"kb_used_meta":2237747,"kb_avail":746113668,"statfs":{"total":773094113280,"available":764020396032,"internally_reserved":0,"allocated":6782185472,"data_stored":6797229658,"data_compressed":70427572,"data_compressed_allocated":73408512,"data_compressed_original":93880320,"omap_allocated":12744,"internal_metadata":2291453496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003419"},"pg_stats":[{"pgid":"3.1f","version":"22'4440","reported_seq":4489,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:32.330441+0000","last_change":"2024-09-16T14:37:24.064528+0000","last_active":"2024-09-16T14:39:32.330441+0000","last_peered":"2024-09-16T14:39:32.330441+0000","last_clean":"2024-09-16T14:39:32.330441+0000","last_became_active":"2024-09-16T14:37:24.063684+0000","last_became_peered":"2024-09-16T14:37:24.063684+0000","last_unstale":"2024-09-16T14:39:32.330441+0000","last_undegraded":"2024-09-16T14:39:32.330441+0000","last_fullsized":"2024-09-16T14:39:32.330441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:52:38.988733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137234784,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":140,"num_read_kb":116,"num_write":4501,"num_write_kb":200999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'6686","reported_seq":6706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:30.934252+0000","last_change":"2024-09-16T14:37:23.861741+0000","last_active":"2024-09-16T14:40:30.934252+0000","last_peered":"2024-09-16T14:40:30.934252+0000","last_clean":"2024-09-16T14:40:30.934252+0000","last_became_active":"2024-09-16T14:37:23.861295+0000","last_became_peered":"2024-09-16T14:37:23.861295+0000","last_unstale":"2024-09-16T14:40:30.934252+0000","last_undegraded":"2024-09-16T14:40:30.934252+0000","last_fullsized":"2024-09-16T14:40:30.934252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6686,"log_dups_size":0,"ondisk_log_size":6686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:53.405081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6680,"num_write_kb":211796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'6871","reported_seq":6897,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:39.797314+0000","last_change":"2024-09-16T14:37:23.875435+0000","last_active":"2024-09-16T14:40:39.797314+0000","last_peered":"2024-09-16T14:40:39.797314+0000","last_clean":"2024-09-16T14:40:39.797314+0000","last_became_active":"2024-09-16T14:37:23.875180+0000","last_became_peered":"2024-09-16T14:37:23.875180+0000","last_unstale":"2024-09-16T14:40:39.797314+0000","last_undegraded":"2024-09-16T14:40:39.797314+0000","last_fullsized":"2024-09-16T14:40:39.797314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6871,"log_dups_size":0,"ondisk_log_size":6871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:39.043377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":56,"num_read_kb":105,"num_write":6978,"num_write_kb":205252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"22'4530","reported_seq":4548,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:54.413706+0000","last_change":"2024-09-16T14:37:23.875704+0000","last_active":"2024-09-16T14:39:54.413706+0000","last_peered":"2024-09-16T14:39:54.413706+0000","last_clean":"2024-09-16T14:39:54.413706+0000","last_became_active":"2024-09-16T14:37:23.875445+0000","last_became_peered":"2024-09-16T14:37:23.875445+0000","last_unstale":"2024-09-16T14:39:54.413706+0000","last_undegraded":"2024-09-16T14:39:54.413706+0000","last_fullsized":"2024-09-16T14:39:54.413706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:02:46.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113247232,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4552,"num_write_kb":157847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'6411","reported_seq":6431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352107+0000","last_change":"2024-09-16T14:37:23.873790+0000","last_active":"2024-09-16T14:40:21.352107+0000","last_peered":"2024-09-16T14:40:21.352107+0000","last_clean":"2024-09-16T14:40:21.352107+0000","last_became_active":"2024-09-16T14:37:23.873310+0000","last_became_peered":"2024-09-16T14:37:23.873310+0000","last_unstale":"2024-09-16T14:40:21.352107+0000","last_undegraded":"2024-09-16T14:40:21.352107+0000","last_fullsized":"2024-09-16T14:40:21.352107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6411,"log_dups_size":0,"ondisk_log_size":6411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:17:02.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145360720,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":6379,"num_write_kb":204642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'6450","reported_seq":6464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:29.659585+0000","last_change":"2024-09-16T14:37:24.066877+0000","last_active":"2024-09-16T14:40:29.659585+0000","last_peered":"2024-09-16T14:40:29.659585+0000","last_clean":"2024-09-16T14:40:29.659585+0000","last_became_active":"2024-09-16T14:37:24.066152+0000","last_became_peered":"2024-09-16T14:37:24.066152+0000","last_unstale":"2024-09-16T14:40:29.659585+0000","last_undegraded":"2024-09-16T14:40:29.659585+0000","last_fullsized":"2024-09-16T14:40:29.659585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6450,"log_dups_size":0,"ondisk_log_size":6450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:44:02.871099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6431,"num_write_kb":206020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"23'4096","reported_seq":4108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352049+0000","last_change":"2024-09-16T14:37:23.874229+0000","last_active":"2024-09-16T14:40:21.352049+0000","last_peered":"2024-09-16T14:40:21.352049+0000","last_clean":"2024-09-16T14:40:21.352049+0000","last_became_active":"2024-09-16T14:37:23.873770+0000","last_became_peered":"2024-09-16T14:37:23.873770+0000","last_unstale":"2024-09-16T14:40:21.352049+0000","last_undegraded":"2024-09-16T14:40:21.352049+0000","last_fullsized":"2024-09-16T14:40:21.352049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:24.022900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4049,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"23'6120","reported_seq":6137,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:26.172770+0000","last_change":"2024-09-16T14:37:23.872533+0000","last_active":"2024-09-16T14:41:26.172770+0000","last_peered":"2024-09-16T14:41:26.172770+0000","last_clean":"2024-09-16T14:41:26.172770+0000","last_became_active":"2024-09-16T14:37:23.872035+0000","last_became_peered":"2024-09-16T14:37:23.872035+0000","last_unstale":"2024-09-16T14:41:26.172770+0000","last_undegraded":"2024-09-16T14:41:26.172770+0000","last_fullsized":"2024-09-16T14:41:26.172770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:54.842566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97783808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6122,"num_write_kb":160588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'5236","reported_seq":5554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:32.732562+0000","last_change":"2024-09-16T14:37:23.867566+0000","last_active":"2024-09-16T14:40:32.732562+0000","last_peered":"2024-09-16T14:40:32.732562+0000","last_clean":"2024-09-16T14:40:32.732562+0000","last_became_active":"2024-09-16T14:37:23.867197+0000","last_became_peered":"2024-09-16T14:37:23.867197+0000","last_unstale":"2024-09-16T14:40:32.732562+0000","last_undegraded":"2024-09-16T14:40:32.732562+0000","last_fullsized":"2024-09-16T14:40:32.732562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:03:22.246821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":1023,"num_read_kb":980,"num_write":5443,"num_write_kb":163369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"23'4373","reported_seq":4488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.262342+0000","last_change":"2024-09-16T14:37:23.867465+0000","last_active":"2024-09-16T14:40:21.262342+0000","last_peered":"2024-09-16T14:40:21.262342+0000","last_clean":"2024-09-16T14:40:21.262342+0000","last_became_active":"2024-09-16T14:37:23.866604+0000","last_became_peered":"2024-09-16T14:37:23.866604+0000","last_unstale":"2024-09-16T14:40:21.262342+0000","last_undegraded":"2024-09-16T14:40:21.262342+0000","last_fullsized":"2024-09-16T14:40:21.262342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4373,"log_dups_size":0,"ondisk_log_size":4373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:53:37.384963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109183504,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":4368,"num_write_kb":166111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'6921","reported_seq":6938,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:41.947670+0000","last_change":"2024-09-16T14:37:23.871305+0000","last_active":"2024-09-16T14:40:41.947670+0000","last_peered":"2024-09-16T14:40:41.947670+0000","last_clean":"2024-09-16T14:40:41.947670+0000","last_became_active":"2024-09-16T14:37:23.871022+0000","last_became_peered":"2024-09-16T14:37:23.871022+0000","last_unstale":"2024-09-16T14:40:41.947670+0000","last_undegraded":"2024-09-16T14:40:41.947670+0000","last_fullsized":"2024-09-16T14:40:41.947670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6921,"log_dups_size":0,"ondisk_log_size":6921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:41.652894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111198208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6926,"num_write_kb":195181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'5443","reported_seq":5460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:33.939569+0000","last_change":"2024-09-16T14:37:23.866707+0000","last_active":"2024-09-16T14:40:33.939569+0000","last_peered":"2024-09-16T14:40:33.939569+0000","last_clean":"2024-09-16T14:40:33.939569+0000","last_became_active":"2024-09-16T14:37:23.866386+0000","last_became_peered":"2024-09-16T14:37:23.866386+0000","last_unstale":"2024-09-16T14:40:33.939569+0000","last_undegraded":"2024-09-16T14:40:33.939569+0000","last_fullsized":"2024-09-16T14:40:33.939569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5443,"log_dups_size":0,"ondisk_log_size":5443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:25:47.217293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":5404,"num_write_kb":164450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:27.462965+0000","last_change":"2024-09-16T14:37:18.312221+0000","last_active":"2024-09-16T14:39:27.462965+0000","last_peered":"2024-09-16T14:39:27.462965+0000","last_clean":"2024-09-16T14:39:27.462965+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:39:27.462965+0000","last_undegraded":"2024-09-16T14:39:27.462965+0000","last_fullsized":"2024-09-16T14:39:27.462965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:52.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'4800","reported_seq":4812,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:39.278658+0000","last_change":"2024-09-16T14:37:23.875261+0000","last_active":"2024-09-16T14:40:39.278658+0000","last_peered":"2024-09-16T14:40:39.278658+0000","last_clean":"2024-09-16T14:40:39.278658+0000","last_became_active":"2024-09-16T14:37:23.874796+0000","last_became_peered":"2024-09-16T14:37:23.874796+0000","last_unstale":"2024-09-16T14:40:39.278658+0000","last_undegraded":"2024-09-16T14:40:39.278658+0000","last_fullsized":"2024-09-16T14:40:39.278658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:55.078935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4775,"num_write_kb":162435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:27.321670+0000","last_change":"2024-09-16T14:37:18.305901+0000","last_active":"2024-09-16T14:39:27.321670+0000","last_peered":"2024-09-16T14:39:27.321670+0000","last_clean":"2024-09-16T14:39:27.321670+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:39:27.321670+0000","last_undegraded":"2024-09-16T14:39:27.321670+0000","last_fullsized":"2024-09-16T14:39:27.321670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:15:04.908893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'3458","reported_seq":3470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.345082+0000","last_change":"2024-09-16T14:37:23.875452+0000","last_active":"2024-09-16T14:40:21.345082+0000","last_peered":"2024-09-16T14:40:21.345082+0000","last_clean":"2024-09-16T14:40:21.345082+0000","last_became_active":"2024-09-16T14:37:23.874901+0000","last_became_peered":"2024-09-16T14:37:23.874901+0000","last_unstale":"2024-09-16T14:40:21.345082+0000","last_undegraded":"2024-09-16T14:40:21.345082+0000","last_fullsized":"2024-09-16T14:40:21.345082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:21.907518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3408,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.951486+0000","last_change":"2024-09-16T14:37:18.311955+0000","last_active":"2024-09-16T14:40:20.951486+0000","last_peered":"2024-09-16T14:40:20.951486+0000","last_clean":"2024-09-16T14:40:20.951486+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:40:20.951486+0000","last_undegraded":"2024-09-16T14:40:20.951486+0000","last_fullsized":"2024-09-16T14:40:20.951486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:15.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'5596","reported_seq":5626,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:34.713566+0000","last_change":"2024-09-16T14:37:23.871434+0000","last_active":"2024-09-16T14:40:34.713566+0000","last_peered":"2024-09-16T14:40:34.713566+0000","last_clean":"2024-09-16T14:40:34.713566+0000","last_became_active":"2024-09-16T14:37:23.871068+0000","last_became_peered":"2024-09-16T14:37:23.871068+0000","last_unstale":"2024-09-16T14:40:34.713566+0000","last_undegraded":"2024-09-16T14:40:34.713566+0000","last_fullsized":"2024-09-16T14:40:34.713566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5596,"log_dups_size":0,"ondisk_log_size":5596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:26:03.808662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":5614,"num_write_kb":199780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.943175+0000","last_change":"2024-09-16T14:37:18.445088+0000","last_active":"2024-09-16T14:40:20.943175+0000","last_peered":"2024-09-16T14:40:20.943175+0000","last_clean":"2024-09-16T14:40:20.943175+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:40:20.943175+0000","last_undegraded":"2024-09-16T14:40:20.943175+0000","last_fullsized":"2024-09-16T14:40:20.943175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:26:02.071763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'4153","reported_seq":4175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.961936+0000","last_change":"2024-09-16T14:37:23.871756+0000","last_active":"2024-09-16T14:40:20.961936+0000","last_peered":"2024-09-16T14:40:20.961936+0000","last_clean":"2024-09-16T14:40:20.961936+0000","last_became_active":"2024-09-16T14:37:23.871465+0000","last_became_peered":"2024-09-16T14:37:23.871465+0000","last_unstale":"2024-09-16T14:40:20.961936+0000","last_undegraded":"2024-09-16T14:40:20.961936+0000","last_fullsized":"2024-09-16T14:40:20.961936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4153,"log_dups_size":0,"ondisk_log_size":4153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:48:14.130571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":4172,"num_write_kb":171144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"22'3334","reported_seq":3370,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.986137+0000","last_change":"2024-09-16T14:37:23.872581+0000","last_active":"2024-09-16T14:40:20.986137+0000","last_peered":"2024-09-16T14:40:20.986137+0000","last_clean":"2024-09-16T14:40:20.986137+0000","last_became_active":"2024-09-16T14:37:23.872385+0000","last_became_peered":"2024-09-16T14:37:23.872385+0000","last_unstale":"2024-09-16T14:40:20.986137+0000","last_undegraded":"2024-09-16T14:40:20.986137+0000","last_fullsized":"2024-09-16T14:40:20.986137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3334,"log_dups_size":0,"ondisk_log_size":3334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:05:22.498912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96731664,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":85,"num_read_kb":129,"num_write":3384,"num_write_kb":160971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950914+0000","last_change":"2024-09-16T14:37:18.311825+0000","last_active":"2024-09-16T14:40:20.950914+0000","last_peered":"2024-09-16T14:40:20.950914+0000","last_clean":"2024-09-16T14:40:20.950914+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:40:20.950914+0000","last_undegraded":"2024-09-16T14:40:20.950914+0000","last_fullsized":"2024-09-16T14:40:20.950914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:34.098272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"23'3338","reported_seq":3359,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.350199+0000","last_change":"2024-09-16T14:37:23.875984+0000","last_active":"2024-09-16T14:40:21.350199+0000","last_peered":"2024-09-16T14:40:21.350199+0000","last_clean":"2024-09-16T14:40:21.350199+0000","last_became_active":"2024-09-16T14:37:23.874911+0000","last_became_peered":"2024-09-16T14:37:23.874911+0000","last_unstale":"2024-09-16T14:40:21.350199+0000","last_undegraded":"2024-09-16T14:40:21.350199+0000","last_fullsized":"2024-09-16T14:40:21.350199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3338,"log_dups_size":0,"ondisk_log_size":3338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3305,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.008141+0000","last_change":"2024-09-16T14:37:18.446072+0000","last_active":"2024-09-16T14:40:21.008141+0000","last_peered":"2024-09-16T14:40:21.008141+0000","last_clean":"2024-09-16T14:40:21.008141+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:40:21.008141+0000","last_undegraded":"2024-09-16T14:40:21.008141+0000","last_fullsized":"2024-09-16T14:40:21.008141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:00:52.557322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'4079","reported_seq":4092,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352467+0000","last_change":"2024-09-16T14:37:23.876205+0000","last_active":"2024-09-16T14:40:21.352467+0000","last_peered":"2024-09-16T14:40:21.352467+0000","last_clean":"2024-09-16T14:40:21.352467+0000","last_became_active":"2024-09-16T14:37:23.875930+0000","last_became_peered":"2024-09-16T14:37:23.875930+0000","last_unstale":"2024-09-16T14:40:21.352467+0000","last_undegraded":"2024-09-16T14:40:21.352467+0000","last_fullsized":"2024-09-16T14:40:21.352467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:02.546999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":169350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950618+0000","last_change":"2024-09-16T14:37:18.310876+0000","last_active":"2024-09-16T14:40:20.950618+0000","last_peered":"2024-09-16T14:40:20.950618+0000","last_clean":"2024-09-16T14:40:20.950618+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:40:20.950618+0000","last_undegraded":"2024-09-16T14:40:20.950618+0000","last_fullsized":"2024-09-16T14:40:20.950618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:54.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'4606","reported_seq":4622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:40.923348+0000","last_change":"2024-09-16T14:37:23.873479+0000","last_active":"2024-09-16T14:40:40.923348+0000","last_peered":"2024-09-16T14:40:40.923348+0000","last_clean":"2024-09-16T14:40:40.923348+0000","last_became_active":"2024-09-16T14:37:23.873060+0000","last_became_peered":"2024-09-16T14:37:23.873060+0000","last_unstale":"2024-09-16T14:40:40.923348+0000","last_undegraded":"2024-09-16T14:40:40.923348+0000","last_fullsized":"2024-09-16T14:40:40.923348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:09:28.912309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96536232,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12,"num_read_kb":135,"num_write":4615,"num_write_kb":187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950893+0000","last_change":"2024-09-16T14:37:18.312343+0000","last_active":"2024-09-16T14:40:20.950893+0000","last_peered":"2024-09-16T14:40:20.950893+0000","last_clean":"2024-09-16T14:40:20.950893+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:40:20.950893+0000","last_undegraded":"2024-09-16T14:40:20.950893+0000","last_fullsized":"2024-09-16T14:40:20.950893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:47:21.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.938773+0000","last_change":"2024-09-16T14:37:15.105418+0000","last_active":"2024-09-16T14:40:20.938773+0000","last_peered":"2024-09-16T14:40:20.938773+0000","last_clean":"2024-09-16T14:40:20.938773+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:40:20.938773+0000","last_undegraded":"2024-09-16T14:40:20.938773+0000","last_fullsized":"2024-09-16T14:40:20.938773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_clean_scrub_stamp":"2024-09-16T14:37:13.233269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:11.758633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3701","reported_seq":3719,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.349658+0000","last_change":"2024-09-16T14:37:23.875363+0000","last_active":"2024-09-16T14:40:21.349658+0000","last_peered":"2024-09-16T14:40:21.349658+0000","last_clean":"2024-09-16T14:40:21.349658+0000","last_became_active":"2024-09-16T14:37:23.874809+0000","last_became_peered":"2024-09-16T14:37:23.874809+0000","last_unstale":"2024-09-16T14:40:21.349658+0000","last_undegraded":"2024-09-16T14:40:21.349658+0000","last_fullsized":"2024-09-16T14:40:21.349658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3701,"log_dups_size":0,"ondisk_log_size":3701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:04.524885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88155160,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":3655,"num_write_kb":140764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"23'8761","reported_seq":8887,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:37.142608+0000","last_change":"2024-09-16T14:37:23.871280+0000","last_active":"2024-09-16T14:40:37.142608+0000","last_peered":"2024-09-16T14:40:37.142608+0000","last_clean":"2024-09-16T14:40:37.142608+0000","last_became_active":"2024-09-16T14:37:23.870990+0000","last_became_peered":"2024-09-16T14:37:23.870990+0000","last_unstale":"2024-09-16T14:40:37.142608+0000","last_undegraded":"2024-09-16T14:40:37.142608+0000","last_fullsized":"2024-09-16T14:40:37.142608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":8761,"log_dups_size":0,"ondisk_log_size":8761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:35:00.974485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":391,"num_read_kb":344,"num_write":6745,"num_write_kb":203146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'4583","reported_seq":4595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.264394+0000","last_change":"2024-09-16T14:37:23.864603+0000","last_active":"2024-09-16T14:40:21.264394+0000","last_peered":"2024-09-16T14:40:21.264394+0000","last_clean":"2024-09-16T14:40:21.264394+0000","last_became_active":"2024-09-16T14:37:23.864034+0000","last_became_peered":"2024-09-16T14:37:23.864034+0000","last_unstale":"2024-09-16T14:40:21.264394+0000","last_undegraded":"2024-09-16T14:40:21.264394+0000","last_fullsized":"2024-09-16T14:40:21.264394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:21.046157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4557,"num_write_kb":210052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"22'3924","reported_seq":3936,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:42.284830+0000","last_change":"2024-09-16T14:37:23.874896+0000","last_active":"2024-09-16T14:39:42.284830+0000","last_peered":"2024-09-16T14:39:42.284830+0000","last_clean":"2024-09-16T14:39:42.284830+0000","last_became_active":"2024-09-16T14:37:23.874573+0000","last_became_peered":"2024-09-16T14:37:23.874573+0000","last_unstale":"2024-09-16T14:39:42.284830+0000","last_undegraded":"2024-09-16T14:39:42.284830+0000","last_fullsized":"2024-09-16T14:39:42.284830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:27.278143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":193410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"23'2810","reported_seq":2822,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.340738+0000","last_change":"2024-09-16T14:37:23.874358+0000","last_active":"2024-09-16T14:40:21.340738+0000","last_peered":"2024-09-16T14:40:21.340738+0000","last_clean":"2024-09-16T14:40:21.340738+0000","last_became_active":"2024-09-16T14:37:23.874099+0000","last_became_peered":"2024-09-16T14:37:23.874099+0000","last_unstale":"2024-09-16T14:40:21.340738+0000","last_undegraded":"2024-09-16T14:40:21.340738+0000","last_fullsized":"2024-09-16T14:40:21.340738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:21.931138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78251856,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":122330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"23'3967","reported_seq":3990,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.258399+0000","last_change":"2024-09-16T14:37:23.865919+0000","last_active":"2024-09-16T14:40:21.258399+0000","last_peered":"2024-09-16T14:40:21.258399+0000","last_clean":"2024-09-16T14:40:21.258399+0000","last_became_active":"2024-09-16T14:37:23.865656+0000","last_became_peered":"2024-09-16T14:37:23.865656+0000","last_unstale":"2024-09-16T14:40:21.258399+0000","last_undegraded":"2024-09-16T14:40:21.258399+0000","last_fullsized":"2024-09-16T14:40:21.258399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:55:33.716535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":36,"num_write":3967,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'4553","reported_seq":4651,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.404323+0000","last_change":"2024-09-16T14:37:23.869225+0000","last_active":"2024-09-16T14:40:21.404323+0000","last_peered":"2024-09-16T14:40:21.404323+0000","last_clean":"2024-09-16T14:40:21.404323+0000","last_became_active":"2024-09-16T14:37:23.868935+0000","last_became_peered":"2024-09-16T14:37:23.868935+0000","last_unstale":"2024-09-16T14:40:21.404323+0000","last_undegraded":"2024-09-16T14:40:21.404323+0000","last_fullsized":"2024-09-16T14:40:21.404323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4553,"log_dups_size":0,"ondisk_log_size":4553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:40:51.366518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100082712,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":335,"num_read_kb":258,"num_write":4833,"num_write_kb":173375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'2696","reported_seq":2710,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.345360+0000","last_change":"2024-09-16T14:37:23.868668+0000","last_active":"2024-09-16T14:40:21.345360+0000","last_peered":"2024-09-16T14:40:21.345360+0000","last_clean":"2024-09-16T14:40:21.345360+0000","last_became_active":"2024-09-16T14:37:23.868262+0000","last_became_peered":"2024-09-16T14:37:23.868262+0000","last_unstale":"2024-09-16T14:40:21.345360+0000","last_undegraded":"2024-09-16T14:40:21.345360+0000","last_fullsized":"2024-09-16T14:40:21.345360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2696,"log_dups_size":0,"ondisk_log_size":2696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:42.842709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79823376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2657,"num_write_kb":119691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'3787","reported_seq":3805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.349906+0000","last_change":"2024-09-16T14:37:24.066472+0000","last_active":"2024-09-16T14:40:21.349906+0000","last_peered":"2024-09-16T14:40:21.349906+0000","last_clean":"2024-09-16T14:40:21.349906+0000","last_became_active":"2024-09-16T14:37:24.065966+0000","last_became_peered":"2024-09-16T14:37:24.065966+0000","last_unstale":"2024-09-16T14:40:21.349906+0000","last_undegraded":"2024-09-16T14:40:21.349906+0000","last_fullsized":"2024-09-16T14:40:21.349906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:16:40.228633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":3750,"num_write_kb":213570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"22'2640","reported_seq":2652,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:47.468331+0000","last_change":"2024-09-16T14:37:23.866814+0000","last_active":"2024-09-16T14:39:47.468331+0000","last_peered":"2024-09-16T14:39:47.468331+0000","last_clean":"2024-09-16T14:39:47.468331+0000","last_became_active":"2024-09-16T14:37:23.866545+0000","last_became_peered":"2024-09-16T14:37:23.866545+0000","last_unstale":"2024-09-16T14:39:47.468331+0000","last_undegraded":"2024-09-16T14:39:47.468331+0000","last_fullsized":"2024-09-16T14:39:47.468331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:50.661424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":119555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"23'2403","reported_seq":2415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.346081+0000","last_change":"2024-09-16T14:37:23.873436+0000","last_active":"2024-09-16T14:40:21.346081+0000","last_peered":"2024-09-16T14:40:21.346081+0000","last_clean":"2024-09-16T14:40:21.346081+0000","last_became_active":"2024-09-16T14:37:23.873069+0000","last_became_peered":"2024-09-16T14:37:23.873069+0000","last_unstale":"2024-09-16T14:40:21.346081+0000","last_undegraded":"2024-09-16T14:40:21.346081+0000","last_fullsized":"2024-09-16T14:40:21.346081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2403,"log_dups_size":0,"ondisk_log_size":2403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:22:12.516441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88145920,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2351,"num_write_kb":101825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"23'7757","reported_seq":7771,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:37.293224+0000","last_change":"2024-09-16T14:37:23.868786+0000","last_active":"2024-09-16T14:40:37.293224+0000","last_peered":"2024-09-16T14:40:37.293224+0000","last_clean":"2024-09-16T14:40:37.293224+0000","last_became_active":"2024-09-16T14:37:23.868469+0000","last_became_peered":"2024-09-16T14:37:23.868469+0000","last_unstale":"2024-09-16T14:40:37.293224+0000","last_undegraded":"2024-09-16T14:40:37.293224+0000","last_fullsized":"2024-09-16T14:40:37.293224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":7757,"log_dups_size":0,"ondisk_log_size":7757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:49:15.825301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":7743,"num_write_kb":271203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3548463880,"num_objects":874,"num_object_clones":0,"num_object_copies":1748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":874,"num_whiteouts":0,"num_read":2497,"num_read_kb":2508,"num_write":150733,"num_write_kb":5600669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6780321792,"data_stored":6795577496,"data_compressed":70367536,"data_compressed_allocated":73326592,"data_compressed_original":92856320,"omap_allocated":0,"internal_metadata":0},"log_size":152523,"ondisk_log_size":152523,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542199,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1039852,"kb_used_data":778276,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93331988,"statfs":{"total":96636764160,"available":95571955712,"internally_reserved":0,"allocated":796954624,"data_stored":799453754,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.68100000000000005},"min":{"1min":0.40200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.3660000000000001,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94899999999999995,"15min":1.0940000000000001},"min":{"1min":0.503,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1519999999999999,"5min":10.654999999999999,"15min":10.654999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70799999999999996,"15min":0.65300000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.522,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0700000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.745,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.86899999999999999,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0960000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.294}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.365,"15min":1.3280000000000001},"min":{"1min":0.45400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.571,"5min":28.141999999999999,"15min":28.141999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.0800000000000001,"15min":0.81799999999999995},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.069,"5min":28.109999999999999,"15min":28.109999999999999},"last":1.113}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90000000000000002,"15min":0.91800000000000004},"min":{"1min":0.41599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.208,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.876},"min":{"1min":0.434,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.256,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.321}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.202,"15min":1.46},"min":{"1min":0.66700000000000004,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1719999999999999,"5min":14.289,"15min":14.289},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.92100000000000004},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.4710000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.431}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96799999999999997,"15min":0.91300000000000003},"min":{"1min":0.57299999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6279999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.387},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.95199999999999996,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2949999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.3480000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1148008,"kb_used_data":850336,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93223832,"statfs":{"total":96636764160,"available":95461203968,"internally_reserved":0,"allocated":870744064,"data_stored":872709495,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.496},"min":{"1min":0.251,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.84199999999999997,"5min":1.857,"15min":1.857},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.84399999999999997,"15min":1.0529999999999999},"min":{"1min":0.255,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.92700000000000005,"5min":12.141,"15min":12.141},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.318,"5min":0.224,"15min":0.224},"max":{"1min":1.1830000000000001,"5min":1.657,"15min":1.657},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.224,"15min":0.224},"max":{"1min":0.86199999999999999,"5min":1.077,"15min":1.077},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.147,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0600000000000001,"15min":0.997},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3009999999999999,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":1.0940000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.343,"5min":1.786,"15min":1.786},"last":1.04},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.95799999999999996,"15min":0.86399999999999999},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.1849999999999996,"5min":5.7869999999999999,"15min":5.7869999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4370000000000001,"5min":1.968,"15min":1.968},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":0.94599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.389,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.073}]},{"osd":7,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.323,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.179},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.89700000000000002},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3089999999999999,"5min":1.7,"15min":1.7},"last":0.96799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191456,"kb_used_data":935640,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93180384,"statfs":{"total":96636764160,"available":95416713216,"internally_reserved":0,"allocated":958095360,"data_stored":959421543,"data_compressed":13128965,"data_compressed_allocated":13701120,"data_compressed_original":15773696,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.70299999999999996,"15min":0.79800000000000004},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":1.181,"5min":3.02,"15min":3.02},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71799999999999997,"15min":0.80200000000000005},"min":{"1min":0.26400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":1.0920000000000001,"5min":3.141,"15min":3.141},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.82199999999999995,"15min":1.0369999999999999},"min":{"1min":0.217,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.96899999999999997,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.747},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.873,"15min":1.0580000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.202,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.427,"15min":1.383},"min":{"1min":0.32400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.82299999999999995,"5min":48.195,"15min":48.195},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.748,"5min":1.4379999999999999,"15min":2.069},"min":{"1min":0.31,"5min":0.246,"15min":0.246},"max":{"1min":1.2609999999999999,"5min":25.248000000000001,"15min":25.248000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3759999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.111},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91400000000000003,"15min":0.88600000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.544,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.337}]},{"osd":5,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.024,"15min":1.1120000000000001},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.206,"5min":5.819,"15min":5.819},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88,"15min":0.83199999999999996},"min":{"1min":0.59499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.371,"5min":1.611,"15min":1.611},"last":1.212}]},{"osd":6,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.94699999999999995},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6479999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.59399999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3620000000000001,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":1.3029999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.466,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":0.875},"min":{"1min":0.51300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3240000000000001,"5min":1.544,"15min":1.544},"last":1.1899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255284,"kb_used_data":921516,"kb_used_omap":1,"kb_used_meta":333758,"kb_avail":93116556,"statfs":{"total":96636764160,"available":95351353344,"internally_reserved":0,"allocated":943632384,"data_stored":944639351,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":1594,"internal_metadata":341768646},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.73299999999999998},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.88700000000000001,"5min":4.9779999999999998,"15min":4.9779999999999998},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91300000000000003,"5min":5.0839999999999996,"15min":5.0839999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.96699999999999997,"15min":1.149},"min":{"1min":0.307,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0449999999999999,"5min":7.6040000000000001,"15min":7.6040000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.262,"15min":1.8340000000000001},"min":{"1min":0.28100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":17.472000000000001,"15min":17.472000000000001},"last":0.996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.78200000000000003},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.254},"max":{"1min":1.073,"5min":3.9649999999999999,"15min":3.9649999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.82799999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.224,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.091},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.115}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.1739999999999999,"15min":1.423},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4239999999999999,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.998,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":5.9429999999999996,"15min":5.9429999999999996},"last":1.2430000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95199999999999996,"15min":0.92000000000000004},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3300000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.034},{"interface":"front","average":{"1min":1.022,"5min":1.173,"15min":1.363},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.4970000000000001,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":1.218}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0880000000000001,"15min":1.1759999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.528,"5min":7.5819999999999999,"15min":7.5819999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.079},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4870000000000001,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":1.1619999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":531216,"kb_used_data":432008,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93840624,"statfs":{"total":96636764160,"available":96092798976,"internally_reserved":0,"allocated":442376192,"data_stored":444217283,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":1589,"internal_metadata":101579211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.1639999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.85399999999999998,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1180000000000001,"5min":8.6959999999999997,"15min":8.6959999999999997},"last":0.88900000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76000000000000001,"15min":0.67700000000000005},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.907,"15min":1.907},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78600000000000003,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.999,"5min":5.798,"15min":5.798},"last":1.022}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.78600000000000003},"min":{"1min":0.56200000000000006,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.169,"5min":4.109,"15min":4.109},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.327,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.1679999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.498,"15min":1.98},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":24.472000000000001,"15min":24.472000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0740000000000001,"15min":1.258},"min":{"1min":0.55300000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1240000000000001,"5min":6.6139999999999999,"15min":6.6139999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82699999999999996,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.29,"5min":1.377,"15min":1.377},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.77000000000000002},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.413,"5min":1.581,"15min":1.581},"last":1.0740000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.83399999999999996},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.339,"5min":1.712,"15min":1.712},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.93000000000000005,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2010000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.008,"15min":0.93999999999999995},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.05},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.248,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.137}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1226112,"kb_used_data":880056,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93145728,"statfs":{"total":96636764160,"available":95381225472,"internally_reserved":0,"allocated":901177344,"data_stored":902461087,"data_compressed":6836315,"data_compressed_allocated":7131136,"data_compressed_original":9027584,"omap_allocated":1594,"internal_metadata":354351558},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.68400000000000005},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.153,"5min":6.4800000000000004,"15min":6.4800000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.81799999999999995},"min":{"1min":0.48599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1020000000000001,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":1.071}]},{"osd":1,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.96399999999999997,"15min":1.034},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.046,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":1.0329999999999999},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82899999999999996,"15min":0.78100000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1910000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.177}]},{"osd":3,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84599999999999997},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.244,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.151},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2250000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.2190000000000001}]},{"osd":4,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.145,"5min":1.319,"15min":1.319},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":4.2720000000000002,"15min":7.6070000000000002},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.399,"5min":91.039000000000001,"15min":91.039000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.038},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99199999999999999,"15min":0.94899999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.006,"15min":0.94299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.337,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1000000000000001,"15min":1.024},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.593,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.246}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":985580,"kb_used_data":729764,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93386260,"statfs":{"total":96636764160,"available":95627530240,"internally_reserved":0,"allocated":747278336,"data_stored":750294603,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.82599999999999996,"15min":0.93799999999999994},"min":{"1min":0.38600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.097,"5min":4.617,"15min":4.617},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66900000000000004,"15min":0.623},"min":{"1min":0.32800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.94499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3520000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.95099999999999996,"15min":1.117},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.212,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":1.0620000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.40899999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":2.528,"15min":2.528},"last":1.103},{"interface":"front","average":{"1min":0.872,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.4530000000000001,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.879,"15min":0.871},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.45000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.278,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1259999999999999}]},{"osd":5,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1559999999999999,"5min":2.726,"15min":2.726},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.55500000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.2689999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.633,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4330000000000001,"5min":1.782,"15min":1.782},"last":1.198}]},{"osd":7,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.49099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.131,"5min":4.556,"15min":4.556},"last":1.153},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0169999999999999,"15min":0.93600000000000005},"min":{"1min":0.5,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3120000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483544,"kb_used_data":1095632,"kb_used_omap":1,"kb_used_meta":387902,"kb_avail":92888296,"statfs":{"total":96636764160,"available":95117615104,"internally_reserved":0,"allocated":1121927168,"data_stored":1124032542,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":1592,"internal_metadata":397212104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.621},"min":{"1min":0.27900000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.84099999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":1.0269999999999999},"min":{"1min":0.34499999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.004,"5min":12.147,"15min":12.147},"last":0.73899999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.28,"5min":1.718,"15min":1.718},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":0.63400000000000001},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77900000000000003,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.67900000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.85299999999999998},"min":{"1min":0.39300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.95299999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0920000000000001,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.78300000000000003}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.5389999999999999,"15min":2.1070000000000002},"min":{"1min":0.433,"5min":0.309,"15min":0.309},"max":{"1min":1.482,"5min":29.449000000000002,"15min":29.449000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.161,"5min":8.4499999999999993,"15min":8.4499999999999993},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.1479999999999999,"15min":1.042},"min":{"1min":0.432,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":11.983000000000001,"5min":11.983000000000001,"15min":11.983000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.242,"15min":1.5740000000000001},"min":{"1min":0.5,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.22,"5min":13.377000000000001,"15min":13.377000000000001},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.161,"15min":1.337},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":13.334,"15min":13.334},"last":1.103},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.569,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1499999999999999,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.7050000000000001,"5min":8.6829999999999998,"15min":8.6829999999999998},"last":1.23},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2010000000000001,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.0070000000000001,"5min":8.7050000000000001,"15min":8.7050000000000001},"last":1.268}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":943415296,"data_stored":944564948,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":957816832,"data_stored":958818212,"data_compressed":13098947,"data_compressed_allocated":13660160,"data_compressed_original":15261696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":870526976,"data_stored":872635092,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1121705984,"data_stored":1123958120,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":747061248,"data_stored":750220200,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":900898816,"data_stored":901857756,"data_compressed":6806297,"data_compressed_allocated":7090176,"data_compressed_original":8515584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":796737536,"data_stored":799380288,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":442159104,"data_stored":444142880,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:41:37.530 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T14:41:37.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:41:37.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.640+0000 7f6022da8700 1 Processor -- start 2024-09-16T14:41:37.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.640+0000 7f6022da8700 1 -- start start 2024-09-16T14:41:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c13f6f0 con 0x7f601c13ef90 2024-09-16T14:41:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c071120 con 0x7f601c0a8910 2024-09-16T14:41:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c06d630 con 0x7f601c070d40 2024-09-16T14:41:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f60225a7700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f601c13ef90 0x7f601c13e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40894/0 (socket says 172.21.15.73:40894) 2024-09-16T14:41:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f60225a7700 1 -- 172.21.15.73:0/2832962958 learned_addr learned my addr 172.21.15.73:0/2832962958 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242316924 0 0) 0x7f601c13f6f0 con 0x7f601c13ef90 2024-09-16T14:41:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60080035d0 con 0x7f601c13ef90 2024-09-16T14:41:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010121939 0 0) 0x7f60080035d0 con 0x7f601c13ef90 2024-09-16T14:41:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 >> v1:172.21.15.73:6790/0 conn(0x7f601c070d40 legacy=0x7f601c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 >> v1:172.21.15.177:6789/0 conn(0x7f601c0a8910 legacy=0x7f601c06cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0a8e50 con 0x7f601c13ef90 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6014001990 con 0x7f601c13ef90 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6014001cb0 con 0x7f601c13ef90 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6020da4700 1 -- 172.21.15.73:0/2832962958 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6014002040 con 0x7f601c13ef90 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- 172.21.15.73:0/2832962958 >> v1:172.21.15.73:6789/0 conn(0x7f601c13ef90 legacy=0x7f601c13e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- 172.21.15.73:0/2832962958 shutdown_connections 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- 172.21.15.73:0/2832962958 >> 172.21.15.73:0/2832962958 conn(0x7f601c06a360 msgr2=0x7f601c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:37.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- 172.21.15.73:0/2832962958 shutdown_connections 2024-09-16T14:41:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.644+0000 7f6022da8700 1 -- 172.21.15.73:0/2832962958 wait complete. 2024-09-16T14:41:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 Processor -- start 2024-09-16T14:41:37.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 -- start start 2024-09-16T14:41:37.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c1d42c0 con 0x7f601c13ef90 2024-09-16T14:41:37.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c13a4d0 con 0x7f601c0a8910 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c1d3f00 con 0x7f601c070d40 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60225a7700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f601c13ef90 0x7f601c134310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40908/0 (socket says 172.21.15.73:40908) 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60225a7700 1 -- 172.21.15.73:0/2437337556 learned_addr learned my addr 172.21.15.73:0/2437337556 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619920327 0 0) 0x7f601c1d3f00 con 0x7f601c070d40 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60000035d0 con 0x7f601c070d40 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257509803 0 0) 0x7f601c1d42c0 con 0x7f601c13ef90 2024-09-16T14:41:37.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c1d3f00 con 0x7f601c13ef90 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2657949484 0 0) 0x7f60000035d0 con 0x7f601c070d40 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f601c1d42c0 con 0x7f601c070d40 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f60180017e0 con 0x7f601c070d40 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964375854 0 0) 0x7f601c13a4d0 con 0x7f601c0a8910 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60000035d0 con 0x7f601c0a8910 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1550514446 0 0) 0x7f601c1d3f00 con 0x7f601c13ef90 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f601c13a4d0 con 0x7f601c13ef90 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f60140017b0 con 0x7f601c13ef90 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1669017568 0 0) 0x7f601c1d42c0 con 0x7f601c070d40 2024-09-16T14:41:37.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 >> v1:172.21.15.177:6789/0 conn(0x7f601c0a8910 legacy=0x7f601c1d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 >> v1:172.21.15.73:6789/0 conn(0x7f601c13ef90 legacy=0x7f601c134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c1d4e60 con 0x7f601c070d40 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c136730 con 0x7f601c070d40 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c1390b0 con 0x7f601c070d40 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f60180036a0 con 0x7f601c070d40 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.648+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6018003a30 con 0x7f601c070d40 2024-09-16T14:41:37.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.652+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6004005100 con 0x7f601c070d40 2024-09-16T14:41:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.652+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f6018003b90 con 0x7f601c070d40 2024-09-16T14:41:37.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.652+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f601807e340 con 0x7f601c070d40 2024-09-16T14:41:37.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.656+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f601804bab0 con 0x7f601c070d40 2024-09-16T14:41:37.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.824+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6004000b90 con 0x7f6000067380 2024-09-16T14:41:37.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.836+0000 7f60127fc700 1 -- 172.21.15.73:0/2437337556 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+153628 (unknown 2965378022 0 3317296479) 0x7f6004000b90 con 0x7f6000067380 2024-09-16T14:41:37.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:41:37.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.836+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 >> v1:172.21.15.177:6816/2823028339 conn(0x7f6000067380 legacy=0x7f6000069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.836+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 >> v1:172.21.15.73:6790/0 conn(0x7f601c070d40 legacy=0x7f601c139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.836+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 shutdown_connections 2024-09-16T14:41:37.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.836+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 >> 172.21.15.73:0/2437337556 conn(0x7f601c06a360 msgr2=0x7f601c13c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:37.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.836+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 shutdown_connections 2024-09-16T14:41:37.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.840+0000 7f6022da8700 1 -- 172.21.15.73:0/2437337556 wait complete. 2024-09-16T14:41:37.846 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:41:37.859 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-16T14:41:37.227179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3549054267,"num_objects":878,"num_object_clones":0,"num_object_copies":1756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":2613,"num_read_kb":2608,"num_write":150894,"num_write_kb":5603087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152643,"ondisk_log_size":152643,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8861052,"kb_used_data":6623228,"kb_used_omap":12,"kb_used_meta":2237747,"kb_avail":746113668,"statfs":{"total":773094113280,"available":764020396032,"internally_reserved":0,"allocated":6782185472,"data_stored":6797229658,"data_compressed":70427572,"data_compressed_allocated":73408512,"data_compressed_original":93880320,"omap_allocated":12744,"internal_metadata":2291453496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003419"},"pg_stats":[{"pgid":"3.1f","version":"22'4440","reported_seq":4489,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:32.330441+0000","last_change":"2024-09-16T14:37:24.064528+0000","last_active":"2024-09-16T14:39:32.330441+0000","last_peered":"2024-09-16T14:39:32.330441+0000","last_clean":"2024-09-16T14:39:32.330441+0000","last_became_active":"2024-09-16T14:37:24.063684+0000","last_became_peered":"2024-09-16T14:37:24.063684+0000","last_unstale":"2024-09-16T14:39:32.330441+0000","last_undegraded":"2024-09-16T14:39:32.330441+0000","last_fullsized":"2024-09-16T14:39:32.330441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:52:38.988733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137234784,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":140,"num_read_kb":116,"num_write":4501,"num_write_kb":200999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"23'6686","reported_seq":6706,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:30.934252+0000","last_change":"2024-09-16T14:37:23.861741+0000","last_active":"2024-09-16T14:40:30.934252+0000","last_peered":"2024-09-16T14:40:30.934252+0000","last_clean":"2024-09-16T14:40:30.934252+0000","last_became_active":"2024-09-16T14:37:23.861295+0000","last_became_peered":"2024-09-16T14:37:23.861295+0000","last_unstale":"2024-09-16T14:40:30.934252+0000","last_undegraded":"2024-09-16T14:40:30.934252+0000","last_fullsized":"2024-09-16T14:40:30.934252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6686,"log_dups_size":0,"ondisk_log_size":6686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:46:53.405081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6680,"num_write_kb":211796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'6871","reported_seq":6897,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:39.797314+0000","last_change":"2024-09-16T14:37:23.875435+0000","last_active":"2024-09-16T14:40:39.797314+0000","last_peered":"2024-09-16T14:40:39.797314+0000","last_clean":"2024-09-16T14:40:39.797314+0000","last_became_active":"2024-09-16T14:37:23.875180+0000","last_became_peered":"2024-09-16T14:37:23.875180+0000","last_unstale":"2024-09-16T14:40:39.797314+0000","last_undegraded":"2024-09-16T14:40:39.797314+0000","last_fullsized":"2024-09-16T14:40:39.797314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6871,"log_dups_size":0,"ondisk_log_size":6871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:32:39.043377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":56,"num_read_kb":105,"num_write":6978,"num_write_kb":205252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"22'4530","reported_seq":4548,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:54.413706+0000","last_change":"2024-09-16T14:37:23.875704+0000","last_active":"2024-09-16T14:39:54.413706+0000","last_peered":"2024-09-16T14:39:54.413706+0000","last_clean":"2024-09-16T14:39:54.413706+0000","last_became_active":"2024-09-16T14:37:23.875445+0000","last_became_peered":"2024-09-16T14:37:23.875445+0000","last_unstale":"2024-09-16T14:39:54.413706+0000","last_undegraded":"2024-09-16T14:39:54.413706+0000","last_fullsized":"2024-09-16T14:39:54.413706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:02:46.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113247232,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4552,"num_write_kb":157847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'6411","reported_seq":6431,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352107+0000","last_change":"2024-09-16T14:37:23.873790+0000","last_active":"2024-09-16T14:40:21.352107+0000","last_peered":"2024-09-16T14:40:21.352107+0000","last_clean":"2024-09-16T14:40:21.352107+0000","last_became_active":"2024-09-16T14:37:23.873310+0000","last_became_peered":"2024-09-16T14:37:23.873310+0000","last_unstale":"2024-09-16T14:40:21.352107+0000","last_undegraded":"2024-09-16T14:40:21.352107+0000","last_fullsized":"2024-09-16T14:40:21.352107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6411,"log_dups_size":0,"ondisk_log_size":6411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:17:02.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145360720,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":6379,"num_write_kb":204642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'6450","reported_seq":6464,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:29.659585+0000","last_change":"2024-09-16T14:37:24.066877+0000","last_active":"2024-09-16T14:40:29.659585+0000","last_peered":"2024-09-16T14:40:29.659585+0000","last_clean":"2024-09-16T14:40:29.659585+0000","last_became_active":"2024-09-16T14:37:24.066152+0000","last_became_peered":"2024-09-16T14:37:24.066152+0000","last_unstale":"2024-09-16T14:40:29.659585+0000","last_undegraded":"2024-09-16T14:40:29.659585+0000","last_fullsized":"2024-09-16T14:40:29.659585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6450,"log_dups_size":0,"ondisk_log_size":6450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:44:02.871099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6431,"num_write_kb":206020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"23'4096","reported_seq":4108,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352049+0000","last_change":"2024-09-16T14:37:23.874229+0000","last_active":"2024-09-16T14:40:21.352049+0000","last_peered":"2024-09-16T14:40:21.352049+0000","last_clean":"2024-09-16T14:40:21.352049+0000","last_became_active":"2024-09-16T14:37:23.873770+0000","last_became_peered":"2024-09-16T14:37:23.873770+0000","last_unstale":"2024-09-16T14:40:21.352049+0000","last_undegraded":"2024-09-16T14:40:21.352049+0000","last_fullsized":"2024-09-16T14:40:21.352049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4096,"log_dups_size":0,"ondisk_log_size":4096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:51:24.022900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4049,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"23'6120","reported_seq":6137,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:26.172770+0000","last_change":"2024-09-16T14:37:23.872533+0000","last_active":"2024-09-16T14:41:26.172770+0000","last_peered":"2024-09-16T14:41:26.172770+0000","last_clean":"2024-09-16T14:41:26.172770+0000","last_became_active":"2024-09-16T14:37:23.872035+0000","last_became_peered":"2024-09-16T14:37:23.872035+0000","last_unstale":"2024-09-16T14:41:26.172770+0000","last_undegraded":"2024-09-16T14:41:26.172770+0000","last_fullsized":"2024-09-16T14:41:26.172770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:03:54.842566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97783808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6122,"num_write_kb":160588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'5236","reported_seq":5554,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:32.732562+0000","last_change":"2024-09-16T14:37:23.867566+0000","last_active":"2024-09-16T14:40:32.732562+0000","last_peered":"2024-09-16T14:40:32.732562+0000","last_clean":"2024-09-16T14:40:32.732562+0000","last_became_active":"2024-09-16T14:37:23.867197+0000","last_became_peered":"2024-09-16T14:37:23.867197+0000","last_unstale":"2024-09-16T14:40:32.732562+0000","last_undegraded":"2024-09-16T14:40:32.732562+0000","last_fullsized":"2024-09-16T14:40:32.732562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:03:22.246821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":1023,"num_read_kb":980,"num_write":5443,"num_write_kb":163369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"23'4373","reported_seq":4488,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.262342+0000","last_change":"2024-09-16T14:37:23.867465+0000","last_active":"2024-09-16T14:40:21.262342+0000","last_peered":"2024-09-16T14:40:21.262342+0000","last_clean":"2024-09-16T14:40:21.262342+0000","last_became_active":"2024-09-16T14:37:23.866604+0000","last_became_peered":"2024-09-16T14:37:23.866604+0000","last_unstale":"2024-09-16T14:40:21.262342+0000","last_undegraded":"2024-09-16T14:40:21.262342+0000","last_fullsized":"2024-09-16T14:40:21.262342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4373,"log_dups_size":0,"ondisk_log_size":4373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:53:37.384963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109183504,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":4368,"num_write_kb":166111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'6921","reported_seq":6938,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:41.947670+0000","last_change":"2024-09-16T14:37:23.871305+0000","last_active":"2024-09-16T14:40:41.947670+0000","last_peered":"2024-09-16T14:40:41.947670+0000","last_clean":"2024-09-16T14:40:41.947670+0000","last_became_active":"2024-09-16T14:37:23.871022+0000","last_became_peered":"2024-09-16T14:37:23.871022+0000","last_unstale":"2024-09-16T14:40:41.947670+0000","last_undegraded":"2024-09-16T14:40:41.947670+0000","last_fullsized":"2024-09-16T14:40:41.947670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6921,"log_dups_size":0,"ondisk_log_size":6921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:41.652894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111198208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6926,"num_write_kb":195181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"23'5443","reported_seq":5460,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:33.939569+0000","last_change":"2024-09-16T14:37:23.866707+0000","last_active":"2024-09-16T14:40:33.939569+0000","last_peered":"2024-09-16T14:40:33.939569+0000","last_clean":"2024-09-16T14:40:33.939569+0000","last_became_active":"2024-09-16T14:37:23.866386+0000","last_became_peered":"2024-09-16T14:37:23.866386+0000","last_unstale":"2024-09-16T14:40:33.939569+0000","last_undegraded":"2024-09-16T14:40:33.939569+0000","last_fullsized":"2024-09-16T14:40:33.939569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5443,"log_dups_size":0,"ondisk_log_size":5443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:25:47.217293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":5404,"num_write_kb":164450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:27.462965+0000","last_change":"2024-09-16T14:37:18.312221+0000","last_active":"2024-09-16T14:39:27.462965+0000","last_peered":"2024-09-16T14:39:27.462965+0000","last_clean":"2024-09-16T14:39:27.462965+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:39:27.462965+0000","last_undegraded":"2024-09-16T14:39:27.462965+0000","last_fullsized":"2024-09-16T14:39:27.462965+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:52.402301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'4800","reported_seq":4812,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:39.278658+0000","last_change":"2024-09-16T14:37:23.875261+0000","last_active":"2024-09-16T14:40:39.278658+0000","last_peered":"2024-09-16T14:40:39.278658+0000","last_clean":"2024-09-16T14:40:39.278658+0000","last_became_active":"2024-09-16T14:37:23.874796+0000","last_became_peered":"2024-09-16T14:37:23.874796+0000","last_unstale":"2024-09-16T14:40:39.278658+0000","last_undegraded":"2024-09-16T14:40:39.278658+0000","last_fullsized":"2024-09-16T14:40:39.278658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4800,"log_dups_size":0,"ondisk_log_size":4800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:43:55.078935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4775,"num_write_kb":162435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:27.321670+0000","last_change":"2024-09-16T14:37:18.305901+0000","last_active":"2024-09-16T14:39:27.321670+0000","last_peered":"2024-09-16T14:39:27.321670+0000","last_clean":"2024-09-16T14:39:27.321670+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:39:27.321670+0000","last_undegraded":"2024-09-16T14:39:27.321670+0000","last_fullsized":"2024-09-16T14:39:27.321670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:15:04.908893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'3458","reported_seq":3470,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.345082+0000","last_change":"2024-09-16T14:37:23.875452+0000","last_active":"2024-09-16T14:40:21.345082+0000","last_peered":"2024-09-16T14:40:21.345082+0000","last_clean":"2024-09-16T14:40:21.345082+0000","last_became_active":"2024-09-16T14:37:23.874901+0000","last_became_peered":"2024-09-16T14:37:23.874901+0000","last_unstale":"2024-09-16T14:40:21.345082+0000","last_undegraded":"2024-09-16T14:40:21.345082+0000","last_fullsized":"2024-09-16T14:40:21.345082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3458,"log_dups_size":0,"ondisk_log_size":3458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:42:21.907518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3408,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.951486+0000","last_change":"2024-09-16T14:37:18.311955+0000","last_active":"2024-09-16T14:40:20.951486+0000","last_peered":"2024-09-16T14:40:20.951486+0000","last_clean":"2024-09-16T14:40:20.951486+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:40:20.951486+0000","last_undegraded":"2024-09-16T14:40:20.951486+0000","last_fullsized":"2024-09-16T14:40:20.951486+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:34:15.087152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'5596","reported_seq":5626,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:34.713566+0000","last_change":"2024-09-16T14:37:23.871434+0000","last_active":"2024-09-16T14:40:34.713566+0000","last_peered":"2024-09-16T14:40:34.713566+0000","last_clean":"2024-09-16T14:40:34.713566+0000","last_became_active":"2024-09-16T14:37:23.871068+0000","last_became_peered":"2024-09-16T14:37:23.871068+0000","last_unstale":"2024-09-16T14:40:34.713566+0000","last_undegraded":"2024-09-16T14:40:34.713566+0000","last_fullsized":"2024-09-16T14:40:34.713566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5596,"log_dups_size":0,"ondisk_log_size":5596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:26:03.808662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":5614,"num_write_kb":199780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.943175+0000","last_change":"2024-09-16T14:37:18.445088+0000","last_active":"2024-09-16T14:40:20.943175+0000","last_peered":"2024-09-16T14:40:20.943175+0000","last_clean":"2024-09-16T14:40:20.943175+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:40:20.943175+0000","last_undegraded":"2024-09-16T14:40:20.943175+0000","last_fullsized":"2024-09-16T14:40:20.943175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:26:02.071763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'4153","reported_seq":4175,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.961936+0000","last_change":"2024-09-16T14:37:23.871756+0000","last_active":"2024-09-16T14:40:20.961936+0000","last_peered":"2024-09-16T14:40:20.961936+0000","last_clean":"2024-09-16T14:40:20.961936+0000","last_became_active":"2024-09-16T14:37:23.871465+0000","last_became_peered":"2024-09-16T14:37:23.871465+0000","last_unstale":"2024-09-16T14:40:20.961936+0000","last_undegraded":"2024-09-16T14:40:20.961936+0000","last_fullsized":"2024-09-16T14:40:20.961936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4153,"log_dups_size":0,"ondisk_log_size":4153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:48:14.130571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":4172,"num_write_kb":171144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"22'3334","reported_seq":3370,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.986137+0000","last_change":"2024-09-16T14:37:23.872581+0000","last_active":"2024-09-16T14:40:20.986137+0000","last_peered":"2024-09-16T14:40:20.986137+0000","last_clean":"2024-09-16T14:40:20.986137+0000","last_became_active":"2024-09-16T14:37:23.872385+0000","last_became_peered":"2024-09-16T14:37:23.872385+0000","last_unstale":"2024-09-16T14:40:20.986137+0000","last_undegraded":"2024-09-16T14:40:20.986137+0000","last_fullsized":"2024-09-16T14:40:20.986137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3334,"log_dups_size":0,"ondisk_log_size":3334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:05:22.498912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96731664,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":85,"num_read_kb":129,"num_write":3384,"num_write_kb":160971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950914+0000","last_change":"2024-09-16T14:37:18.311825+0000","last_active":"2024-09-16T14:40:20.950914+0000","last_peered":"2024-09-16T14:40:20.950914+0000","last_clean":"2024-09-16T14:40:20.950914+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:40:20.950914+0000","last_undegraded":"2024-09-16T14:40:20.950914+0000","last_fullsized":"2024-09-16T14:40:20.950914+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:47:34.098272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"23'3338","reported_seq":3359,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.350199+0000","last_change":"2024-09-16T14:37:23.875984+0000","last_active":"2024-09-16T14:40:21.350199+0000","last_peered":"2024-09-16T14:40:21.350199+0000","last_clean":"2024-09-16T14:40:21.350199+0000","last_became_active":"2024-09-16T14:37:23.874911+0000","last_became_peered":"2024-09-16T14:37:23.874911+0000","last_unstale":"2024-09-16T14:40:21.350199+0000","last_undegraded":"2024-09-16T14:40:21.350199+0000","last_fullsized":"2024-09-16T14:40:21.350199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3338,"log_dups_size":0,"ondisk_log_size":3338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:42:38.608317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3305,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.008141+0000","last_change":"2024-09-16T14:37:18.446072+0000","last_active":"2024-09-16T14:40:21.008141+0000","last_peered":"2024-09-16T14:40:21.008141+0000","last_clean":"2024-09-16T14:40:21.008141+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:40:21.008141+0000","last_undegraded":"2024-09-16T14:40:21.008141+0000","last_fullsized":"2024-09-16T14:40:21.008141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:00:52.557322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"23'4079","reported_seq":4092,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.352467+0000","last_change":"2024-09-16T14:37:23.876205+0000","last_active":"2024-09-16T14:40:21.352467+0000","last_peered":"2024-09-16T14:40:21.352467+0000","last_clean":"2024-09-16T14:40:21.352467+0000","last_became_active":"2024-09-16T14:37:23.875930+0000","last_became_peered":"2024-09-16T14:37:23.875930+0000","last_unstale":"2024-09-16T14:40:21.352467+0000","last_undegraded":"2024-09-16T14:40:21.352467+0000","last_fullsized":"2024-09-16T14:40:21.352467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4079,"log_dups_size":0,"ondisk_log_size":4079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:02.546999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":169350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950618+0000","last_change":"2024-09-16T14:37:18.310876+0000","last_active":"2024-09-16T14:40:20.950618+0000","last_peered":"2024-09-16T14:40:20.950618+0000","last_clean":"2024-09-16T14:40:20.950618+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:40:20.950618+0000","last_undegraded":"2024-09-16T14:40:20.950618+0000","last_fullsized":"2024-09-16T14:40:20.950618+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:54.999192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'4606","reported_seq":4622,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:40.923348+0000","last_change":"2024-09-16T14:37:23.873479+0000","last_active":"2024-09-16T14:40:40.923348+0000","last_peered":"2024-09-16T14:40:40.923348+0000","last_clean":"2024-09-16T14:40:40.923348+0000","last_became_active":"2024-09-16T14:37:23.873060+0000","last_became_peered":"2024-09-16T14:37:23.873060+0000","last_unstale":"2024-09-16T14:40:40.923348+0000","last_undegraded":"2024-09-16T14:40:40.923348+0000","last_fullsized":"2024-09-16T14:40:40.923348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:09:28.912309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96536232,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12,"num_read_kb":135,"num_write":4615,"num_write_kb":187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.950893+0000","last_change":"2024-09-16T14:37:18.312343+0000","last_active":"2024-09-16T14:40:20.950893+0000","last_peered":"2024-09-16T14:40:20.950893+0000","last_clean":"2024-09-16T14:40:20.950893+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:40:20.950893+0000","last_undegraded":"2024-09-16T14:40:20.950893+0000","last_fullsized":"2024-09-16T14:40:20.950893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:47:21.317688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.938773+0000","last_change":"2024-09-16T14:37:15.105418+0000","last_active":"2024-09-16T14:40:20.938773+0000","last_peered":"2024-09-16T14:40:20.938773+0000","last_clean":"2024-09-16T14:40:20.938773+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:40:20.938773+0000","last_undegraded":"2024-09-16T14:40:20.938773+0000","last_fullsized":"2024-09-16T14:40:20.938773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_clean_scrub_stamp":"2024-09-16T14:37:13.233269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:11.758633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"23'3701","reported_seq":3719,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.349658+0000","last_change":"2024-09-16T14:37:23.875363+0000","last_active":"2024-09-16T14:40:21.349658+0000","last_peered":"2024-09-16T14:40:21.349658+0000","last_clean":"2024-09-16T14:40:21.349658+0000","last_became_active":"2024-09-16T14:37:23.874809+0000","last_became_peered":"2024-09-16T14:37:23.874809+0000","last_unstale":"2024-09-16T14:40:21.349658+0000","last_undegraded":"2024-09-16T14:40:21.349658+0000","last_fullsized":"2024-09-16T14:40:21.349658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3701,"log_dups_size":0,"ondisk_log_size":3701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:28:04.524885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88155160,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":3655,"num_write_kb":140764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"23'8761","reported_seq":8887,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:37.142608+0000","last_change":"2024-09-16T14:37:23.871280+0000","last_active":"2024-09-16T14:40:37.142608+0000","last_peered":"2024-09-16T14:40:37.142608+0000","last_clean":"2024-09-16T14:40:37.142608+0000","last_became_active":"2024-09-16T14:37:23.870990+0000","last_became_peered":"2024-09-16T14:37:23.870990+0000","last_unstale":"2024-09-16T14:40:37.142608+0000","last_undegraded":"2024-09-16T14:40:37.142608+0000","last_fullsized":"2024-09-16T14:40:37.142608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":8761,"log_dups_size":0,"ondisk_log_size":8761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:35:00.974485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":391,"num_read_kb":344,"num_write":6745,"num_write_kb":203146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"23'4583","reported_seq":4595,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.264394+0000","last_change":"2024-09-16T14:37:23.864603+0000","last_active":"2024-09-16T14:40:21.264394+0000","last_peered":"2024-09-16T14:40:21.264394+0000","last_clean":"2024-09-16T14:40:21.264394+0000","last_became_active":"2024-09-16T14:37:23.864034+0000","last_became_peered":"2024-09-16T14:37:23.864034+0000","last_unstale":"2024-09-16T14:40:21.264394+0000","last_undegraded":"2024-09-16T14:40:21.264394+0000","last_fullsized":"2024-09-16T14:40:21.264394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:54:21.046157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4557,"num_write_kb":210052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"22'3924","reported_seq":3936,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:42.284830+0000","last_change":"2024-09-16T14:37:23.874896+0000","last_active":"2024-09-16T14:39:42.284830+0000","last_peered":"2024-09-16T14:39:42.284830+0000","last_clean":"2024-09-16T14:39:42.284830+0000","last_became_active":"2024-09-16T14:37:23.874573+0000","last_became_peered":"2024-09-16T14:37:23.874573+0000","last_unstale":"2024-09-16T14:39:42.284830+0000","last_undegraded":"2024-09-16T14:39:42.284830+0000","last_fullsized":"2024-09-16T14:39:42.284830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:27.278143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":193410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"23'2810","reported_seq":2822,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.340738+0000","last_change":"2024-09-16T14:37:23.874358+0000","last_active":"2024-09-16T14:40:21.340738+0000","last_peered":"2024-09-16T14:40:21.340738+0000","last_clean":"2024-09-16T14:40:21.340738+0000","last_became_active":"2024-09-16T14:37:23.874099+0000","last_became_peered":"2024-09-16T14:37:23.874099+0000","last_unstale":"2024-09-16T14:40:21.340738+0000","last_undegraded":"2024-09-16T14:40:21.340738+0000","last_fullsized":"2024-09-16T14:40:21.340738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2810,"log_dups_size":0,"ondisk_log_size":2810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:21.931138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78251856,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":122330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"23'3967","reported_seq":3990,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.258399+0000","last_change":"2024-09-16T14:37:23.865919+0000","last_active":"2024-09-16T14:40:21.258399+0000","last_peered":"2024-09-16T14:40:21.258399+0000","last_clean":"2024-09-16T14:40:21.258399+0000","last_became_active":"2024-09-16T14:37:23.865656+0000","last_became_peered":"2024-09-16T14:37:23.865656+0000","last_unstale":"2024-09-16T14:40:21.258399+0000","last_undegraded":"2024-09-16T14:40:21.258399+0000","last_fullsized":"2024-09-16T14:40:21.258399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3967,"log_dups_size":0,"ondisk_log_size":3967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:55:33.716535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":36,"num_write":3967,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"23'4553","reported_seq":4651,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.404323+0000","last_change":"2024-09-16T14:37:23.869225+0000","last_active":"2024-09-16T14:40:21.404323+0000","last_peered":"2024-09-16T14:40:21.404323+0000","last_clean":"2024-09-16T14:40:21.404323+0000","last_became_active":"2024-09-16T14:37:23.868935+0000","last_became_peered":"2024-09-16T14:37:23.868935+0000","last_unstale":"2024-09-16T14:40:21.404323+0000","last_undegraded":"2024-09-16T14:40:21.404323+0000","last_fullsized":"2024-09-16T14:40:21.404323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4553,"log_dups_size":0,"ondisk_log_size":4553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:40:51.366518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100082712,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":335,"num_read_kb":258,"num_write":4833,"num_write_kb":173375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"23'2696","reported_seq":2710,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.345360+0000","last_change":"2024-09-16T14:37:23.868668+0000","last_active":"2024-09-16T14:40:21.345360+0000","last_peered":"2024-09-16T14:40:21.345360+0000","last_clean":"2024-09-16T14:40:21.345360+0000","last_became_active":"2024-09-16T14:37:23.868262+0000","last_became_peered":"2024-09-16T14:37:23.868262+0000","last_unstale":"2024-09-16T14:40:21.345360+0000","last_undegraded":"2024-09-16T14:40:21.345360+0000","last_fullsized":"2024-09-16T14:40:21.345360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2696,"log_dups_size":0,"ondisk_log_size":2696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:42.842709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79823376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2657,"num_write_kb":119691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'3787","reported_seq":3805,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.349906+0000","last_change":"2024-09-16T14:37:24.066472+0000","last_active":"2024-09-16T14:40:21.349906+0000","last_peered":"2024-09-16T14:40:21.349906+0000","last_clean":"2024-09-16T14:40:21.349906+0000","last_became_active":"2024-09-16T14:37:24.065966+0000","last_became_peered":"2024-09-16T14:37:24.065966+0000","last_unstale":"2024-09-16T14:40:21.349906+0000","last_undegraded":"2024-09-16T14:40:21.349906+0000","last_fullsized":"2024-09-16T14:40:21.349906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3787,"log_dups_size":0,"ondisk_log_size":3787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:16:40.228633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":3750,"num_write_kb":213570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"22'2640","reported_seq":2652,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-16T14:39:47.468331+0000","last_change":"2024-09-16T14:37:23.866814+0000","last_active":"2024-09-16T14:39:47.468331+0000","last_peered":"2024-09-16T14:39:47.468331+0000","last_clean":"2024-09-16T14:39:47.468331+0000","last_became_active":"2024-09-16T14:37:23.866545+0000","last_became_peered":"2024-09-16T14:37:23.866545+0000","last_unstale":"2024-09-16T14:39:47.468331+0000","last_undegraded":"2024-09-16T14:39:47.468331+0000","last_fullsized":"2024-09-16T14:39:47.468331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:41:50.661424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":119555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"23'2403","reported_seq":2415,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.346081+0000","last_change":"2024-09-16T14:37:23.873436+0000","last_active":"2024-09-16T14:40:21.346081+0000","last_peered":"2024-09-16T14:40:21.346081+0000","last_clean":"2024-09-16T14:40:21.346081+0000","last_became_active":"2024-09-16T14:37:23.873069+0000","last_became_peered":"2024-09-16T14:37:23.873069+0000","last_unstale":"2024-09-16T14:40:21.346081+0000","last_undegraded":"2024-09-16T14:40:21.346081+0000","last_fullsized":"2024-09-16T14:40:21.346081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2403,"log_dups_size":0,"ondisk_log_size":2403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:22:12.516441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88145920,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2351,"num_write_kb":101825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"23'7757","reported_seq":7771,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:37.293224+0000","last_change":"2024-09-16T14:37:23.868786+0000","last_active":"2024-09-16T14:40:37.293224+0000","last_peered":"2024-09-16T14:40:37.293224+0000","last_clean":"2024-09-16T14:40:37.293224+0000","last_became_active":"2024-09-16T14:37:23.868469+0000","last_became_peered":"2024-09-16T14:37:23.868469+0000","last_unstale":"2024-09-16T14:40:37.293224+0000","last_undegraded":"2024-09-16T14:40:37.293224+0000","last_fullsized":"2024-09-16T14:40:37.293224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":7757,"log_dups_size":0,"ondisk_log_size":7757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:49:15.825301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":7743,"num_write_kb":271203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3548463880,"num_objects":874,"num_object_clones":0,"num_object_copies":1748,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":874,"num_whiteouts":0,"num_read":2497,"num_read_kb":2508,"num_write":150733,"num_write_kb":5600669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6780321792,"data_stored":6795577496,"data_compressed":70367536,"data_compressed_allocated":73326592,"data_compressed_original":92856320,"omap_allocated":0,"internal_metadata":0},"log_size":152523,"ondisk_log_size":152523,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542199,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1039852,"kb_used_data":778276,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93331988,"statfs":{"total":96636764160,"available":95571955712,"internally_reserved":0,"allocated":796954624,"data_stored":799453754,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.68100000000000005},"min":{"1min":0.40200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.3660000000000001,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":0.90300000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94899999999999995,"15min":1.0940000000000001},"min":{"1min":0.503,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1519999999999999,"5min":10.654999999999999,"15min":10.654999999999999},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70799999999999996,"15min":0.65300000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.522,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0700000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.745,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.878,"5min":0.86899999999999999,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0960000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.294}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.365,"15min":1.3280000000000001},"min":{"1min":0.45400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.571,"5min":28.141999999999999,"15min":28.141999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.0800000000000001,"15min":0.81799999999999995},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.069,"5min":28.109999999999999,"15min":28.109999999999999},"last":1.113}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90000000000000002,"15min":0.91800000000000004},"min":{"1min":0.41599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.208,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.876},"min":{"1min":0.434,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.256,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.321}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.202,"15min":1.46},"min":{"1min":0.66700000000000004,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1719999999999999,"5min":14.289,"15min":14.289},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.92100000000000004},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.4710000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.431}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96799999999999997,"15min":0.91300000000000003},"min":{"1min":0.57299999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6279999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.387},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.95199999999999996,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2949999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.3480000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1148008,"kb_used_data":850336,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93223832,"statfs":{"total":96636764160,"available":95461203968,"internally_reserved":0,"allocated":870744064,"data_stored":872709495,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.496},"min":{"1min":0.251,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.84199999999999997,"5min":1.857,"15min":1.857},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69799999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.84399999999999997,"15min":1.0529999999999999},"min":{"1min":0.255,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.92700000000000005,"5min":12.141,"15min":12.141},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.318,"5min":0.224,"15min":0.224},"max":{"1min":1.1830000000000001,"5min":1.657,"15min":1.657},"last":0.90100000000000002}]},{"osd":3,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.224,"15min":0.224},"max":{"1min":0.86199999999999999,"5min":1.077,"15min":1.077},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.147,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0600000000000001,"15min":0.997},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3009999999999999,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":1.0940000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.343,"5min":1.786,"15min":1.786},"last":1.04},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.95799999999999996,"15min":0.86399999999999999},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.1849999999999996,"5min":5.7869999999999999,"15min":5.7869999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4370000000000001,"5min":1.968,"15min":1.968},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":0.94599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.389,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.073}]},{"osd":7,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.323,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.179},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.89700000000000002},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3089999999999999,"5min":1.7,"15min":1.7},"last":0.96799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191456,"kb_used_data":935640,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93180384,"statfs":{"total":96636764160,"available":95416713216,"internally_reserved":0,"allocated":958095360,"data_stored":959421543,"data_compressed":13128965,"data_compressed_allocated":13701120,"data_compressed_original":15773696,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.70299999999999996,"15min":0.79800000000000004},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":1.181,"5min":3.02,"15min":3.02},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71799999999999997,"15min":0.80200000000000005},"min":{"1min":0.26400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":1.0920000000000001,"5min":3.141,"15min":3.141},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.82199999999999995,"15min":1.0369999999999999},"min":{"1min":0.217,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.96899999999999997,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.747},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.873,"15min":1.0580000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.202,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.79200000000000004}]},{"osd":3,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.427,"15min":1.383},"min":{"1min":0.32400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.82299999999999995,"5min":48.195,"15min":48.195},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.748,"5min":1.4379999999999999,"15min":2.069},"min":{"1min":0.31,"5min":0.246,"15min":0.246},"max":{"1min":1.2609999999999999,"5min":25.248000000000001,"15min":25.248000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3759999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.111},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91400000000000003,"15min":0.88600000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.544,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.337}]},{"osd":5,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.024,"15min":1.1120000000000001},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.206,"5min":5.819,"15min":5.819},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88,"15min":0.83199999999999996},"min":{"1min":0.59499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.371,"5min":1.611,"15min":1.611},"last":1.212}]},{"osd":6,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.94699999999999995},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6479999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.3959999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.59399999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3620000000000001,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":1.3029999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.466,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.3660000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":0.875},"min":{"1min":0.51300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3240000000000001,"5min":1.544,"15min":1.544},"last":1.1899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542199,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255284,"kb_used_data":921516,"kb_used_omap":1,"kb_used_meta":333758,"kb_avail":93116556,"statfs":{"total":96636764160,"available":95351353344,"internally_reserved":0,"allocated":943632384,"data_stored":944639351,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":1594,"internal_metadata":341768646},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.73299999999999998},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.88700000000000001,"5min":4.9779999999999998,"15min":4.9779999999999998},"last":0.68600000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91300000000000003,"5min":5.0839999999999996,"15min":5.0839999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.96699999999999997,"15min":1.149},"min":{"1min":0.307,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0449999999999999,"5min":7.6040000000000001,"15min":7.6040000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.262,"15min":1.8340000000000001},"min":{"1min":0.28100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":17.472000000000001,"15min":17.472000000000001},"last":0.996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.78200000000000003},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.254},"max":{"1min":1.073,"5min":3.9649999999999999,"15min":3.9649999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.82799999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.224,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.091},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.115}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.1739999999999999,"15min":1.423},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4239999999999999,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.998,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":5.9429999999999996,"15min":5.9429999999999996},"last":1.2430000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95199999999999996,"15min":0.92000000000000004},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3300000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.034},{"interface":"front","average":{"1min":1.022,"5min":1.173,"15min":1.363},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.4970000000000001,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":1.218}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0880000000000001,"15min":1.1759999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.528,"5min":7.5819999999999999,"15min":7.5819999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.079},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4870000000000001,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":1.1619999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":531216,"kb_used_data":432008,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93840624,"statfs":{"total":96636764160,"available":96092798976,"internally_reserved":0,"allocated":442376192,"data_stored":444217283,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":1589,"internal_metadata":101579211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.1639999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.85399999999999998,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1180000000000001,"5min":8.6959999999999997,"15min":8.6959999999999997},"last":0.88900000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76000000000000001,"15min":0.67700000000000005},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.907,"15min":1.907},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78600000000000003,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.999,"5min":5.798,"15min":5.798},"last":1.022}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.78600000000000003},"min":{"1min":0.56200000000000006,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.169,"5min":4.109,"15min":4.109},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.327,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.1679999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.498,"15min":1.98},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":24.472000000000001,"15min":24.472000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0740000000000001,"15min":1.258},"min":{"1min":0.55300000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1240000000000001,"5min":6.6139999999999999,"15min":6.6139999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82699999999999996,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.29,"5min":1.377,"15min":1.377},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.77000000000000002},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.413,"5min":1.581,"15min":1.581},"last":1.0740000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.83399999999999996},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.339,"5min":1.712,"15min":1.712},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.93000000000000005,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2010000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.008,"15min":0.93999999999999995},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.05},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.248,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.137}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1226112,"kb_used_data":880056,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93145728,"statfs":{"total":96636764160,"available":95381225472,"internally_reserved":0,"allocated":901177344,"data_stored":902461087,"data_compressed":6836315,"data_compressed_allocated":7131136,"data_compressed_original":9027584,"omap_allocated":1594,"internal_metadata":354351558},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:40:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.68400000000000005},"min":{"1min":0.32400000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.153,"5min":6.4800000000000004,"15min":6.4800000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.81799999999999995},"min":{"1min":0.48599999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1020000000000001,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":1.071}]},{"osd":1,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.96399999999999997,"15min":1.034},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.046,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":1.0329999999999999},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":0.81899999999999995}]},{"osd":2,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82899999999999996,"15min":0.78100000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1910000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.177}]},{"osd":3,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84599999999999997},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.244,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.151},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2250000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.2190000000000001}]},{"osd":4,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.145,"5min":1.319,"15min":1.319},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":4.2720000000000002,"15min":7.6070000000000002},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.399,"5min":91.039000000000001,"15min":91.039000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.038},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99199999999999999,"15min":0.94899999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.006,"15min":0.94299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.337,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.1000000000000001,"15min":1.024},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.593,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.246}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":985580,"kb_used_data":729764,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93386260,"statfs":{"total":96636764160,"available":95627530240,"internally_reserved":0,"allocated":747278336,"data_stored":750294603,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.82599999999999996,"15min":0.93799999999999994},"min":{"1min":0.38600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.097,"5min":4.617,"15min":4.617},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66900000000000004,"15min":0.623},"min":{"1min":0.32800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.94499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3520000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.95099999999999996,"15min":1.117},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.212,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":1.0620000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.40899999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":2.528,"15min":2.528},"last":1.103},{"interface":"front","average":{"1min":0.872,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.4530000000000001,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.99199999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.879,"15min":0.871},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.45000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.278,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1259999999999999}]},{"osd":5,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1559999999999999,"5min":2.726,"15min":2.726},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.55500000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.2689999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.633,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4330000000000001,"5min":1.782,"15min":1.782},"last":1.198}]},{"osd":7,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.49099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.131,"5min":4.556,"15min":4.556},"last":1.153},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0169999999999999,"15min":0.93600000000000005},"min":{"1min":0.5,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.3120000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483544,"kb_used_data":1095632,"kb_used_omap":1,"kb_used_meta":387902,"kb_avail":92888296,"statfs":{"total":96636764160,"available":95117615104,"internally_reserved":0,"allocated":1121927168,"data_stored":1124032542,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":1592,"internal_metadata":397212104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.621},"min":{"1min":0.27900000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.84099999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":1.0269999999999999},"min":{"1min":0.34499999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.004,"5min":12.147,"15min":12.147},"last":0.73899999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.28,"5min":1.718,"15min":1.718},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":0.63400000000000001},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77900000000000003,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.67900000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.85299999999999998},"min":{"1min":0.39300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.95299999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0920000000000001,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.78300000000000003}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.5389999999999999,"15min":2.1070000000000002},"min":{"1min":0.433,"5min":0.309,"15min":0.309},"max":{"1min":1.482,"5min":29.449000000000002,"15min":29.449000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.161,"5min":8.4499999999999993,"15min":8.4499999999999993},"last":0.83699999999999997}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.1479999999999999,"15min":1.042},"min":{"1min":0.432,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":11.983000000000001,"5min":11.983000000000001,"15min":11.983000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.242,"15min":1.5740000000000001},"min":{"1min":0.5,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.22,"5min":13.377000000000001,"15min":13.377000000000001},"last":0.96899999999999997}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.161,"15min":1.337},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":13.334,"15min":13.334},"last":1.103},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.569,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":1.1599999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1499999999999999,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.7050000000000001,"5min":8.6829999999999998,"15min":8.6829999999999998},"last":1.23},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2010000000000001,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.0070000000000001,"5min":8.7050000000000001,"15min":8.7050000000000001},"last":1.268}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":943415296,"data_stored":944564948,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":957816832,"data_stored":958818212,"data_compressed":13098947,"data_compressed_allocated":13660160,"data_compressed_original":15261696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":870526976,"data_stored":872635092,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1121705984,"data_stored":1123958120,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":747061248,"data_stored":750220200,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":900898816,"data_stored":901857756,"data_compressed":6806297,"data_compressed_allocated":7090176,"data_compressed_original":8515584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":796737536,"data_stored":799380288,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":442159104,"data_stored":444142880,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:41:37.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T14:41:37.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 Processor -- start 2024-09-16T14:41:37.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- start start 2024-09-16T14:41:37.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c070cd0 con 0x7f549c0711a0 2024-09-16T14:41:37.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c06d570 con 0x7f549c0705a0 2024-09-16T14:41:37.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c06f6e0 con 0x7f549c06d190 2024-09-16T14:41:37.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a113a700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f549c06d190 0x7f549c13d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:33986/0 (socket says 172.21.15.73:33986) 2024-09-16T14:41:37.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a113a700 1 -- 172.21.15.73:0/3733794011 learned_addr learned my addr 172.21.15.73:0/3733794011 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:37.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a193b700 1 --1- 172.21.15.73:0/3733794011 >> v1:172.21.15.73:6789/0 conn(0x7f549c0711a0 0x7f549c06efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40912/0 (socket says 172.21.15.73:40912) 2024-09-16T14:41:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628040649 0 0) 0x7f549c070cd0 con 0x7f549c0711a0 2024-09-16T14:41:37.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54880035d0 con 0x7f549c0711a0 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129701560 0 0) 0x7f549c06f6e0 con 0x7f549c06d190 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c070cd0 con 0x7f549c06d190 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258179555 0 0) 0x7f549c06d570 con 0x7f549c0705a0 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c06f6e0 con 0x7f549c0705a0 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019319598 0 0) 0x7f549c070cd0 con 0x7f549c06d190 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 >> v1:172.21.15.177:6789/0 conn(0x7f549c0705a0 legacy=0x7f549c06e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 >> v1:172.21.15.73:6789/0 conn(0x7f549c0711a0 legacy=0x7f549c06efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c13db90 con 0x7f549c06d190 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f548c0015f0 con 0x7f549c06d190 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f548c001890 con 0x7f549c06d190 2024-09-16T14:41:37.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f5493fff700 1 -- 172.21.15.73:0/3733794011 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f548c001c60 con 0x7f549c06d190 2024-09-16T14:41:37.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- 172.21.15.73:0/3733794011 >> v1:172.21.15.73:6790/0 conn(0x7f549c06d190 legacy=0x7f549c13d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- 172.21.15.73:0/3733794011 shutdown_connections 2024-09-16T14:41:37.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- 172.21.15.73:0/3733794011 >> 172.21.15.73:0/3733794011 conn(0x7f549c06a360 msgr2=0x7f549c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:37.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- 172.21.15.73:0/3733794011 shutdown_connections 2024-09-16T14:41:37.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.968+0000 7f54a339e700 1 -- 172.21.15.73:0/3733794011 wait complete. 2024-09-16T14:41:37.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a339e700 1 Processor -- start 2024-09-16T14:41:37.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a339e700 1 -- start start 2024-09-16T14:41:37.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a339e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c140150 con 0x7f549c0711a0 2024-09-16T14:41:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a339e700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c140800 con 0x7f549c137980 2024-09-16T14:41:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a339e700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c141b10 con 0x7f549c06d190 2024-09-16T14:41:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a113a700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f549c06d190 0x7f549c13f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:33998/0 (socket says 172.21.15.73:33998) 2024-09-16T14:41:37.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f54a113a700 1 -- 172.21.15.73:0/2534738944 learned_addr learned my addr 172.21.15.73:0/2534738944 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708943358 0 0) 0x7f549c140150 con 0x7f549c0711a0 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54800035d0 con 0x7f549c0711a0 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693905898 0 0) 0x7f549c141b10 con 0x7f549c06d190 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c140150 con 0x7f549c06d190 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225464892 0 0) 0x7f549c140800 con 0x7f549c137980 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c141b10 con 0x7f549c137980 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2789623033 0 0) 0x7f54800035d0 con 0x7f549c0711a0 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f549c140800 con 0x7f549c0711a0 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54980018b0 con 0x7f549c0711a0 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.972+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4121086321 0 0) 0x7f549c140150 con 0x7f549c06d190 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54800035d0 con 0x7f549c06d190 2024-09-16T14:41:37.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f548c001c60 con 0x7f549c06d190 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 130685431 0 0) 0x7f549c140800 con 0x7f549c0711a0 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 >> v1:172.21.15.73:6790/0 conn(0x7f549c06d190 legacy=0x7f549c13f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 >> v1:172.21.15.177:6789/0 conn(0x7f549c137980 legacy=0x7f549c1dc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c142180 con 0x7f549c0711a0 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c1413b0 con 0x7f549c0711a0 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c141840 con 0x7f549c0711a0 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54980036c0 con 0x7f549c0711a0 2024-09-16T14:41:37.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54980039d0 con 0x7f549c0711a0 2024-09-16T14:41:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c005100 con 0x7f549c0711a0 2024-09-16T14:41:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f5498018b70 con 0x7f549c0711a0 2024-09-16T14:41:37.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.976+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f549807e4a0 con 0x7f549c0711a0 2024-09-16T14:41:37.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:37.984+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f549804bb10 con 0x7f549c0711a0 2024-09-16T14:41:38.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.152+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f547c0053b0 con 0x7f549c0711a0 2024-09-16T14:41:38.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.156+0000 7f5491ffb700 1 -- 172.21.15.73:0/2534738944 <== mon.0 v1:172.21.15.73:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14586 (unknown 3496218867 0 4230332318) 0x7f549804da40 con 0x7f549c0711a0 2024-09-16T14:41:38.160 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:41:38.161 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":24,"fsid":"00a48c31-0009-4414-a6e8-5009f0ad4af8","created":"2024-09-16T14:37:03.904421+0000","modified":"2024-09-16T14:41:36.305133+0000","last_up_change":"2024-09-16T14:37:13.233269+0000","last_in_change":"2024-09-16T14:37:05.980210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T14:37:13.207309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-16T14:37:14.708831+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephsqlite","create_time":"2024-09-16T14:37:22.986269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1d48450e-baaa-42ad-93b9-30c34ec79d62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6804","nonce":3200602632}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6805","nonce":3200602632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6807","nonce":3200602632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6806","nonce":3200602632}]},"public_addr":"172.21.15.73:6804/3200602632","cluster_addr":"172.21.15.73:6805/3200602632","heartbeat_back_addr":"172.21.15.73:6807/3200602632","heartbeat_front_addr":"172.21.15.73:6806/3200602632","state":["exists","up"]},{"osd":1,"uuid":"58e40796-3999-48ed-a83f-ad57036a99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6808","nonce":342316973}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6809","nonce":342316973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6811","nonce":342316973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6810","nonce":342316973}]},"public_addr":"172.21.15.73:6808/342316973","cluster_addr":"172.21.15.73:6809/342316973","heartbeat_back_addr":"172.21.15.73:6811/342316973","heartbeat_front_addr":"172.21.15.73:6810/342316973","state":["exists","up"]},{"osd":2,"uuid":"53fdea0d-c928-4266-bfc7-9fbd991a9fb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6800","nonce":303375583}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6801","nonce":303375583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6803","nonce":303375583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6802","nonce":303375583}]},"public_addr":"172.21.15.73:6800/303375583","cluster_addr":"172.21.15.73:6801/303375583","heartbeat_back_addr":"172.21.15.73:6803/303375583","heartbeat_front_addr":"172.21.15.73:6802/303375583","state":["exists","up"]},{"osd":3,"uuid":"fbf3a6da-fa7d-4901-86bd-fe8c90665a54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6812","nonce":1569396656}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6813","nonce":1569396656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6815","nonce":1569396656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.73:6814","nonce":1569396656}]},"public_addr":"172.21.15.73:6812/1569396656","cluster_addr":"172.21.15.73:6813/1569396656","heartbeat_back_addr":"172.21.15.73:6815/1569396656","heartbeat_front_addr":"172.21.15.73:6814/1569396656","state":["exists","up"]},{"osd":4,"uuid":"f493a27b-6fca-494f-9031-d13e97c866e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6801","nonce":573978299}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6803","nonce":573978299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6807","nonce":573978299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6805","nonce":573978299}]},"public_addr":"172.21.15.177:6801/573978299","cluster_addr":"172.21.15.177:6803/573978299","heartbeat_back_addr":"172.21.15.177:6807/573978299","heartbeat_front_addr":"172.21.15.177:6805/573978299","state":["exists","up"]},{"osd":5,"uuid":"076a5b78-a7c6-4897-8381-dd264f4f4be9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6809","nonce":702447135}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6811","nonce":702447135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6815","nonce":702447135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6813","nonce":702447135}]},"public_addr":"172.21.15.177:6809/702447135","cluster_addr":"172.21.15.177:6811/702447135","heartbeat_back_addr":"172.21.15.177:6815/702447135","heartbeat_front_addr":"172.21.15.177:6813/702447135","state":["exists","up"]},{"osd":6,"uuid":"50df42c8-9444-4f81-acd2-68b6f84acd9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6800","nonce":877193733}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6802","nonce":877193733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6806","nonce":877193733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6804","nonce":877193733}]},"public_addr":"172.21.15.177:6800/877193733","cluster_addr":"172.21.15.177:6802/877193733","heartbeat_back_addr":"172.21.15.177:6806/877193733","heartbeat_front_addr":"172.21.15.177:6804/877193733","state":["exists","up"]},{"osd":7,"uuid":"2850af42-0ef9-4516-bdf0-2dc6119b1fb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6808","nonce":3844040909}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6810","nonce":3844040909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6814","nonce":3844040909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.177:6812","nonce":3844040909}]},"public_addr":"172.21.15.177:6808/3844040909","cluster_addr":"172.21.15.177:6810/3844040909","heartbeat_back_addr":"172.21.15.177:6814/3844040909","heartbeat_front_addr":"172.21.15.177:6812/3844040909","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.217458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.306016+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.250219+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.823535+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.942853+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.045593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:11.231206+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T14:37:10.777308+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:0/1684674992":"2024-09-16T15:41:36.232663+0000","172.21.15.73:0/2248981176":"2024-09-16T15:40:20.556878+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T14:41:38.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.160+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 >> v1:172.21.15.177:6816/2823028339 conn(0x7f54800673f0 legacy=0x7f54800698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:38.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.160+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 >> v1:172.21.15.73:6789/0 conn(0x7f549c0711a0 legacy=0x7f549c13fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:38.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.160+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 shutdown_connections 2024-09-16T14:41:38.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.160+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 >> 172.21.15.73:0/2534738944 conn(0x7f549c06a360 msgr2=0x7f549c13dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:38.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.160+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 shutdown_connections 2024-09-16T14:41:38.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:38.160+0000 7f54a339e700 1 -- 172.21.15.73:0/2534738944 wait complete. 2024-09-16T14:41:39.182 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T14:41:39.182 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:39.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0acdf15700 1 Processor -- start 2024-09-16T14:41:39.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0acdf15700 1 -- start start 2024-09-16T14:41:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0acdf15700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac806b0c0 con 0x7f0ac806de70 2024-09-16T14:41:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0acdf15700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac806e610 con 0x7f0ac806ace0 2024-09-16T14:41:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0acdf15700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac8141390 con 0x7f0ac813e910 2024-09-16T14:41:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac7fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0ac806de70 0x7f0ac8144c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40926/0 (socket says 172.21.15.73:40926) 2024-09-16T14:41:39.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac7fff700 1 -- 172.21.15.73:0/3476961591 learned_addr learned my addr 172.21.15.73:0/3476961591 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836058962 0 0) 0x7f0ac806b0c0 con 0x7f0ac806de70 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab40035d0 con 0x7f0ac806de70 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428236053 0 0) 0x7f0ac8141390 con 0x7f0ac813e910 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac806b0c0 con 0x7f0ac813e910 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987213274 0 0) 0x7f0ac806e610 con 0x7f0ac806ace0 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac8141390 con 0x7f0ac806ace0 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 158400934 0 0) 0x7f0ab40035d0 con 0x7f0ac806de70 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 >> v1:172.21.15.73:6790/0 conn(0x7f0ac813e910 legacy=0x7f0ac814ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 >> v1:172.21.15.177:6789/0 conn(0x7f0ac806ace0 legacy=0x7f0ac813e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac8141520 con 0x7f0ac806de70 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0ab0001610 con 0x7f0ac806de70 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ab0001830 con 0x7f0ac806de70 2024-09-16T14:41:39.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.308+0000 7f0ac77fe700 1 -- 172.21.15.73:0/3476961591 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0ab0001b40 con 0x7f0ac806de70 2024-09-16T14:41:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- 172.21.15.73:0/3476961591 >> v1:172.21.15.73:6789/0 conn(0x7f0ac806de70 legacy=0x7f0ac8144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- 172.21.15.73:0/3476961591 shutdown_connections 2024-09-16T14:41:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- 172.21.15.73:0/3476961591 >> 172.21.15.73:0/3476961591 conn(0x7f0ac80b7ab0 msgr2=0x7f0ac806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- 172.21.15.73:0/3476961591 shutdown_connections 2024-09-16T14:41:39.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- 172.21.15.73:0/3476961591 wait complete. 2024-09-16T14:41:39.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 Processor -- start 2024-09-16T14:41:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- start start 2024-09-16T14:41:39.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac813afd0 con 0x7f0ac813e910 2024-09-16T14:41:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80b17f0 con 0x7f0ac813a9d0 2024-09-16T14:41:39.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0acdf15700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80b0d50 con 0x7f0ac806ace0 2024-09-16T14:41:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0accf13700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f0ac806ace0 0x7f0ac80ac860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34020/0 (socket says 172.21.15.73:34020) 2024-09-16T14:41:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0ac7fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0ac813e910 0x7f0ac80acf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40932/0 (socket says 172.21.15.73:40932) 2024-09-16T14:41:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.312+0000 7f0accf13700 1 -- 172.21.15.73:0/4113830924 learned_addr learned my addr 172.21.15.73:0/4113830924 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509677414 0 0) 0x7f0ac813afd0 con 0x7f0ac813e910 2024-09-16T14:41:39.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa80035d0 con 0x7f0ac813e910 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993522437 0 0) 0x7f0ac80b0d50 con 0x7f0ac806ace0 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac813afd0 con 0x7f0ac806ace0 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359796870 0 0) 0x7f0ac80b17f0 con 0x7f0ac813a9d0 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac80b0d50 con 0x7f0ac813a9d0 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3753642151 0 0) 0x7f0aa80035d0 con 0x7f0ac813e910 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ac80b17f0 con 0x7f0ac813e910 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0ab0001370 con 0x7f0ac813e910 2024-09-16T14:41:39.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1119259419 0 0) 0x7f0ac80b17f0 con 0x7f0ac813e910 2024-09-16T14:41:39.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 >> v1:172.21.15.73:6790/0 conn(0x7f0ac806ace0 legacy=0x7f0ac80ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 >> v1:172.21.15.177:6789/0 conn(0x7f0ac813a9d0 legacy=0x7f0ac81e1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80b0ee0 con 0x7f0ac813e910 2024-09-16T14:41:39.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac81403b0 con 0x7f0ac813e910 2024-09-16T14:41:39.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac81e2d80 con 0x7f0ac813e910 2024-09-16T14:41:39.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ab0001640 con 0x7f0ac813e910 2024-09-16T14:41:39.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0ab0004ce0 con 0x7f0ac813e910 2024-09-16T14:41:39.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.316+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0aac000f10 con 0x7f0ac813e910 2024-09-16T14:41:39.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.320+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f0ab0019e80 con 0x7f0ac813e910 2024-09-16T14:41:39.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.320+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f0ab007f630 con 0x7f0ac813e910 2024-09-16T14:41:39.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.320+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6804/3200602632 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0aa80728b0 con 0x7f0aa806ec40 2024-09-16T14:41:39.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.320+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f0ab007f9c0 con 0x7f0ac813e910 2024-09-16T14:41:39.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.320+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== osd.0 v1:172.21.15.73:6804/3200602632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f0aa80728b0 con 0x7f0aa806ec40 2024-09-16T14:41:39.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 --> v1:172.21.15.73:6804/3200602632 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0aac002c00 con 0x7f0aa806ec40 2024-09-16T14:41:39.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0ac57fa700 1 -- 172.21.15.73:0/4113830924 <== osd.0 v1:172.21.15.73:6804/3200602632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f0aac002c00 con 0x7f0aa806ec40 2024-09-16T14:41:39.346 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:39.346 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:39.346 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:39.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 >> v1:172.21.15.73:6804/3200602632 conn(0x7f0aa806ec40 legacy=0x7f0aa8071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 >> v1:172.21.15.177:6816/2823028339 conn(0x7f0aa8066eb0 legacy=0x7f0aa8069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 >> v1:172.21.15.73:6789/0 conn(0x7f0ac813e910 legacy=0x7f0ac80acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acd714700 1 -- 172.21.15.73:0/4113830924 reap_dead start 2024-09-16T14:41:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 shutdown_connections 2024-09-16T14:41:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 >> 172.21.15.73:0/4113830924 conn(0x7f0ac80b7ab0 msgr2=0x7f0ac80b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 shutdown_connections 2024-09-16T14:41:39.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.340+0000 7f0acdf15700 1 -- 172.21.15.73:0/4113830924 wait complete. 2024-09-16T14:41:39.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T14:41:39.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 Processor -- start 2024-09-16T14:41:39.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- start start 2024-09-16T14:41:39.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f413f6f0 con 0x7fe9f40a8910 2024-09-16T14:41:39.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f4071120 con 0x7fe9f413ef90 2024-09-16T14:41:39.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f406d630 con 0x7fe9f4070d40 2024-09-16T14:41:39.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f27fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe9f40a8910 0x7fe9f406cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40938/0 (socket says 172.21.15.73:40938) 2024-09-16T14:41:39.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f27fc700 1 -- 172.21.15.73:0/1153202415 learned_addr learned my addr 172.21.15.73:0/1153202415 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f2ffd700 1 --1- 172.21.15.73:0/1153202415 >> v1:172.21.15.73:6790/0 conn(0x7fe9f4070d40 0x7fe9f413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34032/0 (socket says 172.21.15.73:34032) 2024-09-16T14:41:39.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513193566 0 0) 0x7fe9f406d630 con 0x7fe9f4070d40 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9dc0035d0 con 0x7fe9f4070d40 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886723935 0 0) 0x7fe9f413f6f0 con 0x7fe9f40a8910 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f406d630 con 0x7fe9f40a8910 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86774337 0 0) 0x7fe9f4071120 con 0x7fe9f413ef90 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f413f6f0 con 0x7fe9f413ef90 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891989946 0 0) 0x7fe9dc0035d0 con 0x7fe9f4070d40 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 >> v1:172.21.15.177:6789/0 conn(0x7fe9f413ef90 legacy=0x7fe9f413e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 >> v1:172.21.15.73:6789/0 conn(0x7fe9f40a8910 legacy=0x7fe9f406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40a8e50 con 0x7fe9f4070d40 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe9e8001610 con 0x7fe9f4070d40 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe9e80018f0 con 0x7fe9f4070d40 2024-09-16T14:41:39.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f1ffb700 1 -- 172.21.15.73:0/1153202415 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe9e8001cc0 con 0x7fe9f4070d40 2024-09-16T14:41:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- 172.21.15.73:0/1153202415 >> v1:172.21.15.73:6790/0 conn(0x7fe9f4070d40 legacy=0x7fe9f413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- 172.21.15.73:0/1153202415 shutdown_connections 2024-09-16T14:41:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- 172.21.15.73:0/1153202415 >> 172.21.15.73:0/1153202415 conn(0x7fe9f406a360 msgr2=0x7fe9f406a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- 172.21.15.73:0/1153202415 shutdown_connections 2024-09-16T14:41:39.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.484+0000 7fe9f3fff700 1 -- 172.21.15.73:0/1153202415 wait complete. 2024-09-16T14:41:39.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 Processor -- start 2024-09-16T14:41:39.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 -- start start 2024-09-16T14:41:39.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f4141f60 con 0x7fe9f40a8910 2024-09-16T14:41:39.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f4136b10 con 0x7fe9f4070d40 2024-09-16T14:41:39.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f4136fa0 con 0x7fe9f413ef90 2024-09-16T14:41:39.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f27fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe9f40a8910 0x7fe9f4131040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40946/0 (socket says 172.21.15.73:40946) 2024-09-16T14:41:39.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f27fc700 1 -- 172.21.15.73:0/2164847321 learned_addr learned my addr 172.21.15.73:0/2164847321 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541621128 0 0) 0x7fe9f4141f60 con 0x7fe9f40a8910 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e00035d0 con 0x7fe9f40a8910 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088599107 0 0) 0x7fe9f4136fa0 con 0x7fe9f413ef90 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4141f60 con 0x7fe9f413ef90 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238359315 0 0) 0x7fe9f4136b10 con 0x7fe9f4070d40 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4136fa0 con 0x7fe9f4070d40 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 892637113 0 0) 0x7fe9f4141f60 con 0x7fe9f413ef90 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9f4136b10 con 0x7fe9f413ef90 2024-09-16T14:41:39.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe9ec001b10 con 0x7fe9f413ef90 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4006458479 0 0) 0x7fe9e00035d0 con 0x7fe9f40a8910 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9f4141f60 con 0x7fe9f40a8910 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe9e40018b0 con 0x7fe9f40a8910 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1427593433 0 0) 0x7fe9f4136b10 con 0x7fe9f413ef90 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 >> v1:172.21.15.177:6789/0 conn(0x7fe9f4070d40 legacy=0x7fe9f4142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 >> v1:172.21.15.73:6789/0 conn(0x7fe9f40a8910 legacy=0x7fe9f4131040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f41365a0 con 0x7fe9f413ef90 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4136850 con 0x7fe9f413ef90 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f413b080 con 0x7fe9f413ef90 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe9ec003a20 con 0x7fe9f413ef90 2024-09-16T14:41:39.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.488+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe9ec003d30 con 0x7fe9f413ef90 2024-09-16T14:41:39.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.492+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fe9ec018ed0 con 0x7fe9f413ef90 2024-09-16T14:41:39.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.492+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d4005100 con 0x7fe9f413ef90 2024-09-16T14:41:39.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.492+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fe9ec07e760 con 0x7fe9f413ef90 2024-09-16T14:41:39.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.496+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fe9ec04bd70 con 0x7fe9f413ef90 2024-09-16T14:41:39.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.668+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9d4000b90 con 0x7fe9e0067420 2024-09-16T14:41:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.668+0000 7fe9db7fe700 1 -- 172.21.15.73:0/2164847321 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7fe9d4000b90 con 0x7fe9e0067420 2024-09-16T14:41:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.672+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 >> v1:172.21.15.177:6816/2823028339 conn(0x7fe9e0067420 legacy=0x7fe9e00698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.672+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 >> v1:172.21.15.73:6790/0 conn(0x7fe9f413ef90 legacy=0x7fe9f41d3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.672+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 shutdown_connections 2024-09-16T14:41:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.672+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 >> 172.21.15.73:0/2164847321 conn(0x7fe9f406a360 msgr2=0x7fe9f413e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.672+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 shutdown_connections 2024-09-16T14:41:39.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.672+0000 7fe9f3fff700 1 -- 172.21.15.73:0/2164847321 wait complete. 2024-09-16T14:41:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T14:41:39.689 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T14:41:39.689 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:39.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c84ecf700 1 Processor -- start 2024-09-16T14:41:39.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c84ecf700 1 -- start start 2024-09-16T14:41:39.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c84ecf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8006b0c0 con 0x7f2c8006de70 2024-09-16T14:41:39.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c84ecf700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8006e610 con 0x7f2c8006ace0 2024-09-16T14:41:39.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c84ecf700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c80141390 con 0x7f2c8013e910 2024-09-16T14:41:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c7effd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c8006de70 0x7f2c80144c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40954/0 (socket says 172.21.15.73:40954) 2024-09-16T14:41:39.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.800+0000 7f2c7effd700 1 -- 172.21.15.73:0/1682987354 learned_addr learned my addr 172.21.15.73:0/1682987354 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839841749 0 0) 0x7f2c80141390 con 0x7f2c8013e910 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c680035d0 con 0x7f2c8013e910 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897630472 0 0) 0x7f2c8006b0c0 con 0x7f2c8006de70 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c80141390 con 0x7f2c8006de70 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602411344 0 0) 0x7f2c8006e610 con 0x7f2c8006ace0 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8006b0c0 con 0x7f2c8006ace0 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3248605440 0 0) 0x7f2c680035d0 con 0x7f2c8013e910 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 >> v1:172.21.15.177:6789/0 conn(0x7f2c8006ace0 legacy=0x7f2c8013e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 >> v1:172.21.15.73:6789/0 conn(0x7f2c8006de70 legacy=0x7f2c80144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80141520 con 0x7f2c8013e910 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2c78001990 con 0x7f2c8013e910 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2c78001c00 con 0x7f2c8013e910 2024-09-16T14:41:39.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c7e7fc700 1 -- 172.21.15.73:0/1682987354 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2c78001f90 con 0x7f2c8013e910 2024-09-16T14:41:39.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1682987354 >> v1:172.21.15.73:6790/0 conn(0x7f2c8013e910 legacy=0x7f2c8014ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1682987354 shutdown_connections 2024-09-16T14:41:39.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1682987354 >> 172.21.15.73:0/1682987354 conn(0x7f2c800b7ab0 msgr2=0x7f2c8006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1682987354 shutdown_connections 2024-09-16T14:41:39.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.804+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1682987354 wait complete. 2024-09-16T14:41:39.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 Processor -- start 2024-09-16T14:41:39.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 -- start start 2024-09-16T14:41:39.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8013b0c0 con 0x7f2c8006de70 2024-09-16T14:41:39.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c7effd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2c8006de70 0x7f2c80139010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40960/0 (socket says 172.21.15.73:40960) 2024-09-16T14:41:39.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c7effd700 1 -- 172.21.15.73:0/1197604181 learned_addr learned my addr 172.21.15.73:0/1197604181 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8013ad90 con 0x7f2c8013e910 2024-09-16T14:41:39.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c80139e30 con 0x7f2c8006ace0 2024-09-16T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656818626 0 0) 0x7f2c8013b0c0 con 0x7f2c8006de70 2024-09-16T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c0035d0 con 0x7f2c8006de70 2024-09-16T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946474333 0 0) 0x7f2c80139e30 con 0x7f2c8006ace0 2024-09-16T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8013b0c0 con 0x7f2c8006ace0 2024-09-16T14:41:39.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655682300 0 0) 0x7f2c8013ad90 con 0x7f2c8013e910 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c80139e30 con 0x7f2c8013e910 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 784855455 0 0) 0x7f2c6c0035d0 con 0x7f2c8006de70 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c8013ad90 con 0x7f2c8006de70 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2c70001870 con 0x7f2c8006de70 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2849669005 0 0) 0x7f2c8013b0c0 con 0x7f2c8006ace0 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c6c0035d0 con 0x7f2c8006ace0 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2c740018b0 con 0x7f2c8006ace0 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1766483902 0 0) 0x7f2c8013ad90 con 0x7f2c8006de70 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 >> v1:172.21.15.73:6790/0 conn(0x7f2c8006ace0 legacy=0x7f2c80138330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 >> v1:172.21.15.177:6789/0 conn(0x7f2c8013e910 legacy=0x7f2c80139720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800ac860 con 0x7f2c8006de70 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c80138a40 con 0x7f2c8006de70 2024-09-16T14:41:39.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8013fb20 con 0x7f2c8006de70 2024-09-16T14:41:39.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2c70004890 con 0x7f2c8006de70 2024-09-16T14:41:39.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.808+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f2c70004c20 con 0x7f2c8006de70 2024-09-16T14:41:39.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.812+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c60000f10 con 0x7f2c8006de70 2024-09-16T14:41:39.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.812+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f2c70019dc0 con 0x7f2c8006de70 2024-09-16T14:41:39.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.812+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f2c7007f780 con 0x7f2c8006de70 2024-09-16T14:41:39.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.812+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6808/342316973 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c6c072ce0 con 0x7f2c6c06f110 2024-09-16T14:41:39.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.812+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f2c7007fad0 con 0x7f2c8006de70 2024-09-16T14:41:39.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.816+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== osd.1 v1:172.21.15.73:6808/342316973 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f2c6c072ce0 con 0x7f2c6c06f110 2024-09-16T14:41:39.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 --> v1:172.21.15.73:6808/342316973 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c60002c00 con 0x7f2c6c06f110 2024-09-16T14:41:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c67fff700 1 -- 172.21.15.73:0/1197604181 <== osd.1 v1:172.21.15.73:6808/342316973 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f2c60002c00 con 0x7f2c6c06f110 2024-09-16T14:41:39.839 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:39.839 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:39.840 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:39.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 >> v1:172.21.15.73:6808/342316973 conn(0x7f2c6c06f110 legacy=0x7f2c6c071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 >> v1:172.21.15.177:6816/2823028339 conn(0x7f2c6c0672f0 legacy=0x7f2c6c0697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 >> v1:172.21.15.73:6789/0 conn(0x7f2c8006de70 legacy=0x7f2c80139010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c7ffff700 1 -- 172.21.15.73:0/1197604181 reap_dead start 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 shutdown_connections 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 >> 172.21.15.73:0/1197604181 conn(0x7f2c800b7ab0 msgr2=0x7f2c8006a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 shutdown_connections 2024-09-16T14:41:39.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.832+0000 7f2c84ecf700 1 -- 172.21.15.73:0/1197604181 wait complete. 2024-09-16T14:41:39.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T14:41:39.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.960+0000 7f54fe93d700 1 Processor -- start 2024-09-16T14:41:39.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.960+0000 7f54fe93d700 1 -- start start 2024-09-16T14:41:39.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f806e0b0 con 0x7f54f8140c50 2024-09-16T14:41:39.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f806d1c0 con 0x7f54f8144d20 2024-09-16T14:41:39.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f8142160 con 0x7f54f8144940 2024-09-16T14:41:39.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe13c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54f8140c50 0x7f54f814ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40974/0 (socket says 172.21.15.73:40974) 2024-09-16T14:41:39.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe13c700 1 -- 172.21.15.73:0/2133099622 learned_addr learned my addr 172.21.15.73:0/2133099622 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fd93b700 1 --1- 172.21.15.73:0/2133099622 >> v1:172.21.15.73:6790/0 conn(0x7f54f8144940 0x7f54f80ac860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34082/0 (socket says 172.21.15.73:34082) 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179134395 0 0) 0x7f54f806e0b0 con 0x7f54f8140c50 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e40035d0 con 0x7f54f8140c50 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987683653 0 0) 0x7f54f8142160 con 0x7f54f8144940 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f806e0b0 con 0x7f54f8144940 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166553898 0 0) 0x7f54f806d1c0 con 0x7f54f8144d20 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f8142160 con 0x7f54f8144d20 2024-09-16T14:41:39.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797044178 0 0) 0x7f54e40035d0 con 0x7f54f8140c50 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 >> v1:172.21.15.73:6790/0 conn(0x7f54f8144940 legacy=0x7f54f80ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 >> v1:172.21.15.177:6789/0 conn(0x7f54f8144d20 legacy=0x7f54f8140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f81422f0 con 0x7f54f8140c50 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54f0001990 con 0x7f54f8140c50 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54f0001c00 con 0x7f54f8140c50 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fc939700 1 -- 172.21.15.73:0/2133099622 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54f0001f90 con 0x7f54f8140c50 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- 172.21.15.73:0/2133099622 >> v1:172.21.15.73:6789/0 conn(0x7f54f8140c50 legacy=0x7f54f814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- 172.21.15.73:0/2133099622 shutdown_connections 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- 172.21.15.73:0/2133099622 >> 172.21.15.73:0/2133099622 conn(0x7f54f806a360 msgr2=0x7f54f806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- 172.21.15.73:0/2133099622 shutdown_connections 2024-09-16T14:41:39.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.964+0000 7f54fe93d700 1 -- 172.21.15.73:0/2133099622 wait complete. 2024-09-16T14:41:39.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 Processor -- start 2024-09-16T14:41:39.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 -- start start 2024-09-16T14:41:39.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f81d9cb0 con 0x7f54f8140c50 2024-09-16T14:41:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f811c620 con 0x7f54f8144940 2024-09-16T14:41:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f8070070 con 0x7f54f8144d20 2024-09-16T14:41:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fd93b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54f8140c50 0x7f54f8071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40982/0 (socket says 172.21.15.73:40982) 2024-09-16T14:41:39.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fd93b700 1 -- 172.21.15.73:0/3434600237 learned_addr learned my addr 172.21.15.73:0/3434600237 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548439066 0 0) 0x7f54f81d9cb0 con 0x7f54f8140c50 2024-09-16T14:41:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54dc0035d0 con 0x7f54f8140c50 2024-09-16T14:41:39.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479375047 0 0) 0x7f54f8070070 con 0x7f54f8144d20 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f81d9cb0 con 0x7f54f8144d20 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3879357734 0 0) 0x7f54dc0035d0 con 0x7f54f8140c50 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54f8070070 con 0x7f54f8140c50 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380058123 0 0) 0x7f54f811c620 con 0x7f54f8144940 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54dc0035d0 con 0x7f54f8144940 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54e80018b0 con 0x7f54f8140c50 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 870420540 0 0) 0x7f54f81d9cb0 con 0x7f54f8144d20 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54f811c620 con 0x7f54f8144d20 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54f0001950 con 0x7f54f8144d20 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4128605838 0 0) 0x7f54f8070070 con 0x7f54f8140c50 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 >> v1:172.21.15.73:6790/0 conn(0x7f54f8144d20 legacy=0x7f54f81da190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 >> v1:172.21.15.177:6789/0 conn(0x7f54f8144940 legacy=0x7f54f8139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:39.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f8139b20 con 0x7f54f8140c50 2024-09-16T14:41:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f81da8a0 con 0x7f54f8140c50 2024-09-16T14:41:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f806e950 con 0x7f54f8140c50 2024-09-16T14:41:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f54e8001c70 con 0x7f54f8140c50 2024-09-16T14:41:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.968+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f54e8004ce0 con 0x7f54f8140c50 2024-09-16T14:41:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.972+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e0005100 con 0x7f54f8140c50 2024-09-16T14:41:39.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.972+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f54e8019e80 con 0x7f54f8140c50 2024-09-16T14:41:39.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.972+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f54e807f700 con 0x7f54f8140c50 2024-09-16T14:41:39.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:39.976+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f54e804cd10 con 0x7f54f8140c50 2024-09-16T14:41:40.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.148+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f54e0000b90 con 0x7f54dc067430 2024-09-16T14:41:40.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.148+0000 7f54ee7fc700 1 -- 172.21.15.73:0/3434600237 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f54e0000b90 con 0x7f54dc067430 2024-09-16T14:41:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.152+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 >> v1:172.21.15.177:6816/2823028339 conn(0x7f54dc067430 legacy=0x7f54dc0698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.152+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 >> v1:172.21.15.73:6789/0 conn(0x7f54f8140c50 legacy=0x7f54f8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.152+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 shutdown_connections 2024-09-16T14:41:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.152+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 >> 172.21.15.73:0/3434600237 conn(0x7f54f806a360 msgr2=0x7f54f80accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.152+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 shutdown_connections 2024-09-16T14:41:40.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.152+0000 7f54fe93d700 1 -- 172.21.15.73:0/3434600237 wait complete. 2024-09-16T14:41:40.158 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T14:41:40.170 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T14:41:40.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:40.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 Processor -- start 2024-09-16T14:41:40.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- start start 2024-09-16T14:41:40.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c070710 con 0x7f670c0afd90 2024-09-16T14:41:40.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c0b1ac0 con 0x7f670c0b0610 2024-09-16T14:41:40.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c141d40 con 0x7f670c0af9b0 2024-09-16T14:41:40.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f670c0afd90 0x7f670c149860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40986/0 (socket says 172.21.15.73:40986) 2024-09-16T14:41:40.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670b7fe700 1 -- 172.21.15.73:0/3662151136 learned_addr learned my addr 172.21.15.73:0/3662151136 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209645962 0 0) 0x7f670c070710 con 0x7f670c0afd90 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f80035d0 con 0x7f670c0afd90 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181904262 0 0) 0x7f670c141d40 con 0x7f670c0af9b0 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c070710 con 0x7f670c0af9b0 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005398871 0 0) 0x7f66f80035d0 con 0x7f670c0afd90 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 >> v1:172.21.15.73:6790/0 conn(0x7f670c0af9b0 legacy=0x7f670c137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 >> v1:172.21.15.177:6789/0 conn(0x7f670c0b0610 legacy=0x7f670c13df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c06f620 con 0x7f670c0afd90 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f66f4001610 con 0x7f670c0afd90 2024-09-16T14:41:40.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f66f4001870 con 0x7f670c0afd90 2024-09-16T14:41:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f6709ffb700 1 -- 172.21.15.73:0/3662151136 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f66f4001c40 con 0x7f670c0afd90 2024-09-16T14:41:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- 172.21.15.73:0/3662151136 >> v1:172.21.15.73:6789/0 conn(0x7f670c0afd90 legacy=0x7f670c149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- 172.21.15.73:0/3662151136 shutdown_connections 2024-09-16T14:41:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- 172.21.15.73:0/3662151136 >> 172.21.15.73:0/3662151136 conn(0x7f670c0b0aa0 msgr2=0x7f670c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- 172.21.15.73:0/3662151136 shutdown_connections 2024-09-16T14:41:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.288+0000 7f670bfff700 1 -- 172.21.15.73:0/3662151136 wait complete. 2024-09-16T14:41:40.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670bfff700 1 Processor -- start 2024-09-16T14:41:40.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670bfff700 1 -- start start 2024-09-16T14:41:40.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670bfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c1423e0 con 0x7f670c0af9b0 2024-09-16T14:41:40.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670bfff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c1d34f0 con 0x7f670c0afd90 2024-09-16T14:41:40.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670bfff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c0aa890 con 0x7f670c0b0610 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670affd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f670c0af9b0 0x7f670c0aa180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40996/0 (socket says 172.21.15.73:40996) 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f670affd700 1 -- 172.21.15.73:0/3243892195 learned_addr learned my addr 172.21.15.73:0/3243892195 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461236145 0 0) 0x7f670c1423e0 con 0x7f670c0af9b0 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ec0057e0 con 0x7f670c0af9b0 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571133850 0 0) 0x7f670c0aa890 con 0x7f670c0b0610 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c1423e0 con 0x7f670c0b0610 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998163923 0 0) 0x7f670c1d34f0 con 0x7f670c0afd90 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.292+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c0aa890 con 0x7f670c0afd90 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2007732509 0 0) 0x7f66ec0057e0 con 0x7f670c0af9b0 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f670c1d34f0 con 0x7f670c0af9b0 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6704001cd0 con 0x7f670c0af9b0 2024-09-16T14:41:40.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2143804484 0 0) 0x7f670c1423e0 con 0x7f670c0b0610 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66ec0057e0 con 0x7f670c0b0610 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f66f40019e0 con 0x7f670c0b0610 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3432684711 0 0) 0x7f670c0aa890 con 0x7f670c0afd90 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f670c1423e0 con 0x7f670c0afd90 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f66fc001780 con 0x7f670c0afd90 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3405794444 0 0) 0x7f670c1d34f0 con 0x7f670c0af9b0 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 >> v1:172.21.15.73:6790/0 conn(0x7f670c0b0610 legacy=0x7f670c1ddbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 >> v1:172.21.15.177:6789/0 conn(0x7f670c0afd90 legacy=0x7f670c1d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c1d30f0 con 0x7f670c0af9b0 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c1d4090 con 0x7f670c0af9b0 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c0a9840 con 0x7f670c0af9b0 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6704003a40 con 0x7f670c0af9b0 2024-09-16T14:41:40.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f6704003d50 con 0x7f670c0af9b0 2024-09-16T14:41:40.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66f0000f10 con 0x7f670c0af9b0 2024-09-16T14:41:40.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f6704003f30 con 0x7f670c0af9b0 2024-09-16T14:41:40.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f670407fa80 con 0x7f670c0af9b0 2024-09-16T14:41:40.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6800/303375583 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66ec0750f0 con 0x7f66ec071480 2024-09-16T14:41:40.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.296+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f670407ff10 con 0x7f670c0af9b0 2024-09-16T14:41:40.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.300+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== osd.2 v1:172.21.15.73:6800/303375583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f66ec0750f0 con 0x7f66ec071480 2024-09-16T14:41:40.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 --> v1:172.21.15.73:6800/303375583 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f66f0002c00 con 0x7f66ec071480 2024-09-16T14:41:40.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f67037fe700 1 -- 172.21.15.73:0/3243892195 <== osd.2 v1:172.21.15.73:6800/303375583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f66f0002c00 con 0x7f66ec071480 2024-09-16T14:41:40.322 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:40.322 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:40.322 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 >> v1:172.21.15.73:6800/303375583 conn(0x7f66ec071480 legacy=0x7f66ec0738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 >> v1:172.21.15.177:6816/2823028339 conn(0x7f66ec0696d0 legacy=0x7f66ec06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 >> v1:172.21.15.73:6789/0 conn(0x7f670c0af9b0 legacy=0x7f670c0aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670b7fe700 1 -- 172.21.15.73:0/3243892195 reap_dead start 2024-09-16T14:41:40.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 shutdown_connections 2024-09-16T14:41:40.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 >> 172.21.15.73:0/3243892195 conn(0x7f670c0b0aa0 msgr2=0x7f670c070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 shutdown_connections 2024-09-16T14:41:40.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.316+0000 7f670bfff700 1 -- 172.21.15.73:0/3243892195 wait complete. 2024-09-16T14:41:40.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T14:41:40.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 Processor -- start 2024-09-16T14:41:40.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- start start 2024-09-16T14:41:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb013f6f0 con 0x7effb00a8910 2024-09-16T14:41:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0071120 con 0x7effb013ef90 2024-09-16T14:41:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb006d630 con 0x7effb0070d40 2024-09-16T14:41:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaffff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7effb0070d40 0x7effb013fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34114/0 (socket says 172.21.15.73:34114) 2024-09-16T14:41:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaffff700 1 -- 172.21.15.73:0/770392676 learned_addr learned my addr 172.21.15.73:0/770392676 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaf7fe700 1 --1- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6789/0 conn(0x7effb00a8910 0x7effb006cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41010/0 (socket says 172.21.15.73:41010) 2024-09-16T14:41:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaf7fe700 1 -- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6789/0 conn(0x7effb00a8910 legacy=0x7effb006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-16T14:41:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaf7fe700 1 -- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6789/0 conn(0x7effb00a8910 legacy=0x7effb006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:41:40.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaf7fe700 1 --1- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6789/0 conn(0x7effb00a8910 0x7effb006cf20 :-1 s=OPENED pgs=335 cs=1 l=1).handle_message read tag failed 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaf7fe700 1 --1- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6789/0 conn(0x7effb00a8910 0x7effb006cf20 :-1 s=OPENED pgs=335 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173746770 0 0) 0x7effb006d630 con 0x7effb0070d40 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff9c0035d0 con 0x7effb0070d40 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755876742 0 0) 0x7effb0071120 con 0x7effb013ef90 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb006d630 con 0x7effb013ef90 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891016482 0 0) 0x7eff9c0035d0 con 0x7effb0070d40 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 >> v1:172.21.15.177:6789/0 conn(0x7effb013ef90 legacy=0x7effb013e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6789/0 conn(0x7effb00a8910 legacy=0x7effb006cf20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00a8e50 con 0x7effb0070d40 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7effa0001990 con 0x7effb0070d40 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7effa0001c70 con 0x7effb0070d40 2024-09-16T14:41:40.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effaeffd700 1 -- 172.21.15.73:0/770392676 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7effa0002000 con 0x7effb0070d40 2024-09-16T14:41:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- 172.21.15.73:0/770392676 >> v1:172.21.15.73:6790/0 conn(0x7effb0070d40 legacy=0x7effb013fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- 172.21.15.73:0/770392676 shutdown_connections 2024-09-16T14:41:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- 172.21.15.73:0/770392676 >> 172.21.15.73:0/770392676 conn(0x7effb006a360 msgr2=0x7effb006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- 172.21.15.73:0/770392676 shutdown_connections 2024-09-16T14:41:40.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.448+0000 7effb51de700 1 -- 172.21.15.73:0/770392676 wait complete. 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 Processor -- start 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 -- start start 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0138d70 con 0x7effb013ef90 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0139050 con 0x7effb0070d40 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0142840 con 0x7effb00a8910 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb49dd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7effb013ef90 0x7effb01dec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41022/0 (socket says 172.21.15.73:41022) 2024-09-16T14:41:40.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb49dd700 1 -- 172.21.15.73:0/1357299669 learned_addr learned my addr 172.21.15.73:0/1357299669 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353736210 0 0) 0x7effb0138d70 con 0x7effb013ef90 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff900035d0 con 0x7effb013ef90 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542606595 0 0) 0x7effb0142840 con 0x7effb00a8910 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb0138d70 con 0x7effb00a8910 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125949739 0 0) 0x7effb0139050 con 0x7effb0070d40 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb0142840 con 0x7effb0070d40 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 832867272 0 0) 0x7eff900035d0 con 0x7effb013ef90 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7effb0139050 con 0x7effb013ef90 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7effa8001810 con 0x7effb013ef90 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 130054571 0 0) 0x7effb0139050 con 0x7effb013ef90 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 >> v1:172.21.15.73:6790/0 conn(0x7effb00a8910 legacy=0x7effb0140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 >> v1:172.21.15.177:6789/0 conn(0x7effb0070d40 legacy=0x7effb013a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0131e90 con 0x7effb013ef90 2024-09-16T14:41:40.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb0141080 con 0x7effb013ef90 2024-09-16T14:41:40.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7effa80036c0 con 0x7effb013ef90 2024-09-16T14:41:40.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7effa8003a90 con 0x7effb013ef90 2024-09-16T14:41:40.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.452+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7effb01397e0 con 0x7effb013ef90 2024-09-16T14:41:40.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.456+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb0139e90 con 0x7effb013ef90 2024-09-16T14:41:40.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.456+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7effa8003d00 con 0x7effb013ef90 2024-09-16T14:41:40.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.456+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7effa807f4c0 con 0x7effb013ef90 2024-09-16T14:41:40.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.460+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7effa804cc10 con 0x7effb013ef90 2024-09-16T14:41:40.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7effb013ed30 con 0x7eff900670b0 2024-09-16T14:41:40.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effacff9700 1 -- 172.21.15.73:0/1357299669 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7effa00017b0 con 0x7eff900670b0 2024-09-16T14:41:40.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 >> v1:172.21.15.177:6816/2823028339 conn(0x7eff900670b0 legacy=0x7eff90069570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 >> v1:172.21.15.73:6789/0 conn(0x7effb013ef90 legacy=0x7effb01dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 shutdown_connections 2024-09-16T14:41:40.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 >> 172.21.15.73:0/1357299669 conn(0x7effb006a360 msgr2=0x7effb013b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.648+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 shutdown_connections 2024-09-16T14:41:40.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.652+0000 7effb51de700 1 -- 172.21.15.73:0/1357299669 wait complete. 2024-09-16T14:41:40.657 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T14:41:40.668 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T14:41:40.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:40.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.772+0000 7f94a4cdc700 1 Processor -- start 2024-09-16T14:41:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.772+0000 7f94a4cdc700 1 -- start start 2024-09-16T14:41:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a0070480 con 0x7f94a0141d60 2024-09-16T14:41:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a01415f0 con 0x7f94a006de60 2024-09-16T14:41:40.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00706d0 con 0x7f94a01421d0 2024-09-16T14:41:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949effd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f94a0141d60 0x7f94a013e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41034/0 (socket says 172.21.15.73:41034) 2024-09-16T14:41:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949effd700 1 -- 172.21.15.73:0/808547684 learned_addr learned my addr 172.21.15.73:0/808547684 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142523425 0 0) 0x7f94a0070480 con 0x7f94a0141d60 2024-09-16T14:41:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94880035d0 con 0x7f94a0141d60 2024-09-16T14:41:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974342013 0 0) 0x7f94a00706d0 con 0x7f94a01421d0 2024-09-16T14:41:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a0070480 con 0x7f94a01421d0 2024-09-16T14:41:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428108353 0 0) 0x7f94880035d0 con 0x7f94a0141d60 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 >> v1:172.21.15.73:6790/0 conn(0x7f94a01421d0 legacy=0x7f94a013e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 >> v1:172.21.15.177:6789/0 conn(0x7f94a006de60 legacy=0x7f94a006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0141840 con 0x7f94a0141d60 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9494001610 con 0x7f94a0141d60 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9494001830 con 0x7f94a0141d60 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f949e7fc700 1 -- 172.21.15.73:0/808547684 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9494001b80 con 0x7f94a0141d60 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- 172.21.15.73:0/808547684 >> v1:172.21.15.73:6789/0 conn(0x7f94a0141d60 legacy=0x7f94a013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- 172.21.15.73:0/808547684 shutdown_connections 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- 172.21.15.73:0/808547684 >> 172.21.15.73:0/808547684 conn(0x7f94a00b40a0 msgr2=0x7f94a00b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- 172.21.15.73:0/808547684 shutdown_connections 2024-09-16T14:41:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- 172.21.15.73:0/808547684 wait complete. 2024-09-16T14:41:40.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 Processor -- start 2024-09-16T14:41:40.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.776+0000 7f94a4cdc700 1 -- start start 2024-09-16T14:41:40.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f94a4cdc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a0135d80 con 0x7f94a006de60 2024-09-16T14:41:40.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f94a4cdc700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a0135fd0 con 0x7f94a0141d60 2024-09-16T14:41:40.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f94a4cdc700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a01362b0 con 0x7f94a01421d0 2024-09-16T14:41:40.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f949f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f94a006de60 0x7f94a013a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41044/0 (socket says 172.21.15.73:41044) 2024-09-16T14:41:40.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f949f7fe700 1 -- 172.21.15.73:0/3699716385 learned_addr learned my addr 172.21.15.73:0/3699716385 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021072323 0 0) 0x7f94a0135d80 con 0x7f94a006de60 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f948c0035d0 con 0x7f94a006de60 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689105767 0 0) 0x7f94a0135fd0 con 0x7f94a0141d60 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a0135d80 con 0x7f94a0141d60 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746120724 0 0) 0x7f94a01362b0 con 0x7f94a01421d0 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a0135fd0 con 0x7f94a01421d0 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 771440012 0 0) 0x7f948c0035d0 con 0x7f94a006de60 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f94a01362b0 con 0x7f94a006de60 2024-09-16T14:41:40.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9490001c90 con 0x7f94a006de60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 932968807 0 0) 0x7f94a0135fd0 con 0x7f94a01421d0 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f948c0035d0 con 0x7f94a01421d0 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9498001750 con 0x7f94a01421d0 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2009512665 0 0) 0x7f94a0135d80 con 0x7f94a0141d60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f94a0135fd0 con 0x7f94a0141d60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 655373734 0 0) 0x7f94a01362b0 con 0x7f94a006de60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 >> v1:172.21.15.73:6790/0 conn(0x7f94a01421d0 legacy=0x7f94a01dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 >> v1:172.21.15.177:6789/0 conn(0x7f94a0141d60 legacy=0x7f94a013adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a006afc0 con 0x7f94a006de60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a006a940 con 0x7f94a006de60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a01384d0 con 0x7f94a006de60 2024-09-16T14:41:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9490003a80 con 0x7f94a006de60 2024-09-16T14:41:40.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.780+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f9490003d90 con 0x7f94a006de60 2024-09-16T14:41:40.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.784+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f9490003ef0 con 0x7f94a006de60 2024-09-16T14:41:40.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.784+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9480000f10 con 0x7f94a006de60 2024-09-16T14:41:40.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.784+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f949007fa40 con 0x7f94a006de60 2024-09-16T14:41:40.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.784+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6812/1569396656 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f948c072eb0 con 0x7f948c06f2e0 2024-09-16T14:41:40.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.784+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f949007fe70 con 0x7f94a006de60 2024-09-16T14:41:40.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.784+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== osd.3 v1:172.21.15.73:6812/1569396656 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f948c072eb0 con 0x7f948c06f2e0 2024-09-16T14:41:40.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 --> v1:172.21.15.73:6812/1569396656 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9480002c60 con 0x7f948c06f2e0 2024-09-16T14:41:40.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f9487fff700 1 -- 172.21.15.73:0/3699716385 <== osd.3 v1:172.21.15.73:6812/1569396656 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f9480002c60 con 0x7f948c06f2e0 2024-09-16T14:41:40.806 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:40.806 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:40.806 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:40.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 >> v1:172.21.15.73:6812/1569396656 conn(0x7f948c06f2e0 legacy=0x7f948c071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 >> v1:172.21.15.177:6816/2823028339 conn(0x7f948c067530 legacy=0x7f948c0699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 >> v1:172.21.15.73:6789/0 conn(0x7f94a006de60 legacy=0x7f94a013a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f949ffff700 1 -- 172.21.15.73:0/3699716385 reap_dead start 2024-09-16T14:41:40.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 shutdown_connections 2024-09-16T14:41:40.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 >> 172.21.15.73:0/3699716385 conn(0x7f94a00b40a0 msgr2=0x7f94a00ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 shutdown_connections 2024-09-16T14:41:40.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.800+0000 7f94a4cdc700 1 -- 172.21.15.73:0/3699716385 wait complete. 2024-09-16T14:41:40.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T14:41:40.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7effff700 1 Processor -- start 2024-09-16T14:41:40.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7effff700 1 -- start start 2024-09-16T14:41:40.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7effff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f006e0b0 con 0x7fc7f0144940 2024-09-16T14:41:40.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7effff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f006d1c0 con 0x7fc7f0140c50 2024-09-16T14:41:40.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7effff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f0142160 con 0x7fc7f0144d20 2024-09-16T14:41:40.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7eeffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc7f0144940 0x7fc7f00ac860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41060/0 (socket says 172.21.15.73:41060) 2024-09-16T14:41:40.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7eeffd700 1 -- 172.21.15.73:0/2984645241 learned_addr learned my addr 172.21.15.73:0/2984645241 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241023910 0 0) 0x7fc7f006e0b0 con 0x7fc7f0144940 2024-09-16T14:41:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7dc0035d0 con 0x7fc7f0144940 2024-09-16T14:41:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440801441 0 0) 0x7fc7f0142160 con 0x7fc7f0144d20 2024-09-16T14:41:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f006e0b0 con 0x7fc7f0144d20 2024-09-16T14:41:40.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510293677 0 0) 0x7fc7f006d1c0 con 0x7fc7f0140c50 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f0142160 con 0x7fc7f0140c50 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81158458 0 0) 0x7fc7f006e0b0 con 0x7fc7f0144d20 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 >> v1:172.21.15.177:6789/0 conn(0x7fc7f0140c50 legacy=0x7fc7f014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 >> v1:172.21.15.73:6789/0 conn(0x7fc7f0144940 legacy=0x7fc7f00ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f01422f0 con 0x7fc7f0144d20 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc7d80018e0 con 0x7fc7f0144d20 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc7d8001b00 con 0x7fc7f0144d20 2024-09-16T14:41:40.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.924+0000 7fc7edffb700 1 -- 172.21.15.73:0/2984645241 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc7d8001e50 con 0x7fc7f0144d20 2024-09-16T14:41:40.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- 172.21.15.73:0/2984645241 >> v1:172.21.15.73:6790/0 conn(0x7fc7f0144d20 legacy=0x7fc7f0140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- 172.21.15.73:0/2984645241 shutdown_connections 2024-09-16T14:41:40.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- 172.21.15.73:0/2984645241 >> 172.21.15.73:0/2984645241 conn(0x7fc7f006a360 msgr2=0x7fc7f006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:40.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- 172.21.15.73:0/2984645241 shutdown_connections 2024-09-16T14:41:40.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- 172.21.15.73:0/2984645241 wait complete. 2024-09-16T14:41:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 Processor -- start 2024-09-16T14:41:40.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- start start 2024-09-16T14:41:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f013a560 con 0x7fc7f0140c50 2024-09-16T14:41:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00715f0 con 0x7fc7f0144d20 2024-09-16T14:41:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7effff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f01d9d80 con 0x7fc7f0144940 2024-09-16T14:41:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7ee7fc700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc7f0144940 0x7fc7f0139740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34142/0 (socket says 172.21.15.73:34142) 2024-09-16T14:41:40.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7ee7fc700 1 -- 172.21.15.73:0/1973183185 learned_addr learned my addr 172.21.15.73:0/1973183185 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326325450 0 0) 0x7fc7f01d9d80 con 0x7fc7f0144940 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d00035d0 con 0x7fc7f0144940 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030246215 0 0) 0x7fc7f013a560 con 0x7fc7f0140c50 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f01d9d80 con 0x7fc7f0140c50 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591605547 0 0) 0x7fc7f00715f0 con 0x7fc7f0144d20 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.928+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f013a560 con 0x7fc7f0144d20 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3030264021 0 0) 0x7fc7d00035d0 con 0x7fc7f0144940 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7f00715f0 con 0x7fc7f0144940 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc7d8001f10 con 0x7fc7f0144940 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3815572208 0 0) 0x7fc7f01d9d80 con 0x7fc7f0140c50 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7d00035d0 con 0x7fc7f0140c50 2024-09-16T14:41:40.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc7e0001850 con 0x7fc7f0140c50 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 287756108 0 0) 0x7fc7f013a560 con 0x7fc7f0144d20 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc7f01d9d80 con 0x7fc7f0144d20 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc7e80018b0 con 0x7fc7f0144d20 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3053802785 0 0) 0x7fc7d00035d0 con 0x7fc7f0140c50 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 >> v1:172.21.15.73:6790/0 conn(0x7fc7f0144940 legacy=0x7fc7f0139740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 >> v1:172.21.15.177:6789/0 conn(0x7fc7f0144d20 legacy=0x7fc7f0139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f011bc30 con 0x7fc7f0140c50 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f011bee0 con 0x7fc7f0140c50 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc7e0004890 con 0x7fc7f0140c50 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc7e0001d80 con 0x7fc7f0140c50 2024-09-16T14:41:40.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f013aaf0 con 0x7fc7f0140c50 2024-09-16T14:41:40.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f00008d0 con 0x7fc7f0140c50 2024-09-16T14:41:40.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fc7e0019c60 con 0x7fc7f0140c50 2024-09-16T14:41:40.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.932+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fc7e007f5b0 con 0x7fc7f0140c50 2024-09-16T14:41:40.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:40.936+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fc7e004cb30 con 0x7fc7f0140c50 2024-09-16T14:41:41.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.104+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f013ce70 con 0x7fc7d0067480 2024-09-16T14:41:41.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.104+0000 7fc7e7fff700 1 -- 172.21.15.73:0/1973183185 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7fc7f013ce70 con 0x7fc7d0067480 2024-09-16T14:41:41.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.108+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 >> v1:172.21.15.177:6816/2823028339 conn(0x7fc7d0067480 legacy=0x7fc7d0069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.108+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 >> v1:172.21.15.73:6789/0 conn(0x7fc7f0140c50 legacy=0x7fc7f01d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.108+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 shutdown_connections 2024-09-16T14:41:41.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.108+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 >> 172.21.15.73:0/1973183185 conn(0x7fc7f006a360 msgr2=0x7fc7f013b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.108+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 shutdown_connections 2024-09-16T14:41:41.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.108+0000 7fc7effff700 1 -- 172.21.15.73:0/1973183185 wait complete. 2024-09-16T14:41:41.117 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T14:41:41.131 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T14:41:41.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc041d14700 1 Processor -- start 2024-09-16T14:41:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc041d14700 1 -- start start 2024-09-16T14:41:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc041d14700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0340c8950 con 0x7fc034032930 2024-09-16T14:41:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc041d14700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0340349b0 con 0x7fc0340345d0 2024-09-16T14:41:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc041d14700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc034029a60 con 0x7fc03402f910 2024-09-16T14:41:41.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc03bfff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc03402f910 0x7fc0340c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34148/0 (socket says 172.21.15.73:34148) 2024-09-16T14:41:41.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc03bfff700 1 -- 172.21.15.73:0/1258694289 learned_addr learned my addr 172.21.15.73:0/1258694289 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.244+0000 7fc041513700 1 --1- 172.21.15.73:0/1258694289 >> v1:172.21.15.73:6789/0 conn(0x7fc034032930 0x7fc0340c8240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41070/0 (socket says 172.21.15.73:41070) 2024-09-16T14:41:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358050492 0 0) 0x7fc034029a60 con 0x7fc03402f910 2024-09-16T14:41:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c0035d0 con 0x7fc03402f910 2024-09-16T14:41:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036293040 0 0) 0x7fc0340c8950 con 0x7fc034032930 2024-09-16T14:41:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc034029a60 con 0x7fc034032930 2024-09-16T14:41:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276326749 0 0) 0x7fc0340349b0 con 0x7fc0340345d0 2024-09-16T14:41:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0340c8950 con 0x7fc0340345d0 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3216391054 0 0) 0x7fc02c0035d0 con 0x7fc03402f910 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 >> v1:172.21.15.177:6789/0 conn(0x7fc0340345d0 legacy=0x7fc0340c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 >> v1:172.21.15.73:6789/0 conn(0x7fc034032930 legacy=0x7fc0340c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034032ef0 con 0x7fc03402f910 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc030001610 con 0x7fc03402f910 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc030001880 con 0x7fc03402f910 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc03b7fe700 1 -- 172.21.15.73:0/1258694289 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc030001c10 con 0x7fc03402f910 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc041d14700 1 -- 172.21.15.73:0/1258694289 >> v1:172.21.15.73:6790/0 conn(0x7fc03402f910 legacy=0x7fc0340c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc041d14700 1 -- 172.21.15.73:0/1258694289 shutdown_connections 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc041d14700 1 -- 172.21.15.73:0/1258694289 >> 172.21.15.73:0/1258694289 conn(0x7fc0340397a0 msgr2=0x7fc034035810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc041d14700 1 -- 172.21.15.73:0/1258694289 shutdown_connections 2024-09-16T14:41:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.248+0000 7fc041d14700 1 -- 172.21.15.73:0/1258694289 wait complete. 2024-09-16T14:41:41.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 Processor -- start 2024-09-16T14:41:41.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 -- start start 2024-09-16T14:41:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0340b9e60 con 0x7fc0340345d0 2024-09-16T14:41:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0340b9be0 con 0x7fc034032930 2024-09-16T14:41:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03402b5e0 con 0x7fc03402f910 2024-09-16T14:41:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc040d12700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fc03402f910 0x7fc03402fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34150/0 (socket says 172.21.15.73:34150) 2024-09-16T14:41:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc040d12700 1 -- 172.21.15.73:0/1064413183 learned_addr learned my addr 172.21.15.73:0/1064413183 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086222394 0 0) 0x7fc0340b9e60 con 0x7fc0340345d0 2024-09-16T14:41:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0200035d0 con 0x7fc0340345d0 2024-09-16T14:41:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631234478 0 0) 0x7fc03402b5e0 con 0x7fc03402f910 2024-09-16T14:41:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0340b9e60 con 0x7fc03402f910 2024-09-16T14:41:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477560408 0 0) 0x7fc0340b9be0 con 0x7fc034032930 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03402b5e0 con 0x7fc034032930 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3907015150 0 0) 0x7fc0200035d0 con 0x7fc0340345d0 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0340b9be0 con 0x7fc0340345d0 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc03c069410 con 0x7fc0340345d0 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1359938254 0 0) 0x7fc0340b9e60 con 0x7fc03402f910 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0200035d0 con 0x7fc03402f910 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc0280018f0 con 0x7fc03402f910 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3151771948 0 0) 0x7fc0340b9be0 con 0x7fc0340345d0 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 >> v1:172.21.15.73:6790/0 conn(0x7fc03402f910 legacy=0x7fc03402fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 >> v1:172.21.15.177:6789/0 conn(0x7fc034032930 legacy=0x7fc0340b8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034030ba0 con 0x7fc0340345d0 2024-09-16T14:41:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0340cfe00 con 0x7fc0340345d0 2024-09-16T14:41:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.252+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0340ba220 con 0x7fc0340345d0 2024-09-16T14:41:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc03c04ec70 con 0x7fc0340345d0 2024-09-16T14:41:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fc03c04ef50 con 0x7fc0340345d0 2024-09-16T14:41:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc01c000f10 con 0x7fc0340345d0 2024-09-16T14:41:41.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fc03c0008d0 con 0x7fc0340345d0 2024-09-16T14:41:41.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fc03c0f93f0 con 0x7fc0340345d0 2024-09-16T14:41:41.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.177:6801/573978299 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc020072b00 con 0x7fc02006ef30 2024-09-16T14:41:41.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.256+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7fc03c0f9860 con 0x7fc0340345d0 2024-09-16T14:41:41.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.260+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== osd.4 v1:172.21.15.177:6801/573978299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7fc020072b00 con 0x7fc02006ef30 2024-09-16T14:41:41.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.276+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 --> v1:172.21.15.177:6801/573978299 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc01c002c00 con 0x7fc02006ef30 2024-09-16T14:41:41.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc0397fa700 1 -- 172.21.15.73:0/1064413183 <== osd.4 v1:172.21.15.177:6801/573978299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fc01c002c00 con 0x7fc02006ef30 2024-09-16T14:41:41.284 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:41.284 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:41.285 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 >> v1:172.21.15.177:6801/573978299 conn(0x7fc02006ef30 legacy=0x7fc020071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 >> v1:172.21.15.177:6816/2823028339 conn(0x7fc0200670f0 legacy=0x7fc0200695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 >> v1:172.21.15.73:6789/0 conn(0x7fc0340345d0 legacy=0x7fc0340b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041513700 1 -- 172.21.15.73:0/1064413183 reap_dead start 2024-09-16T14:41:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 shutdown_connections 2024-09-16T14:41:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 >> 172.21.15.73:0/1064413183 conn(0x7fc0340397a0 msgr2=0x7fc0340bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 shutdown_connections 2024-09-16T14:41:41.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.280+0000 7fc041d14700 1 -- 172.21.15.73:0/1064413183 wait complete. 2024-09-16T14:41:41.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T14:41:41.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fd7ac700 1 Processor -- start 2024-09-16T14:41:41.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fd7ac700 1 -- start start 2024-09-16T14:41:41.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fd7ac700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80712e0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fd7ac700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f8070560 con 0x7fe4f8070180 2024-09-16T14:41:41.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fd7ac700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f8071530 con 0x7fe4f806f460 2024-09-16T14:41:41.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fcfab700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe4f8141ca0 0x7fe4f814cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41094/0 (socket says 172.21.15.73:41094) 2024-09-16T14:41:41.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4fcfab700 1 -- 172.21.15.73:0/2166196106 learned_addr learned my addr 172.21.15.73:0/2166196106 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.412+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999584716 0 0) 0x7fe4f8071530 con 0x7fe4f806f460 2024-09-16T14:41:41.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e40035d0 con 0x7fe4f806f460 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010169548 0 0) 0x7fe4f80712e0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f8071530 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699216473 0 0) 0x7fe4f8070560 con 0x7fe4f8070180 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f80712e0 con 0x7fe4f8070180 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2778373122 0 0) 0x7fe4f8071530 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 >> v1:172.21.15.73:6790/0 conn(0x7fe4f806f460 legacy=0x7fe4f8141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 >> v1:172.21.15.177:6789/0 conn(0x7fe4f8070180 legacy=0x7fe4f813e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8071810 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe4f0001970 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe4f0001c90 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4f6ffd700 1 -- 172.21.15.73:0/2166196106 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe4f0002020 con 0x7fe4f8141ca0 2024-09-16T14:41:41.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2166196106 >> v1:172.21.15.73:6789/0 conn(0x7fe4f8141ca0 legacy=0x7fe4f814cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2166196106 shutdown_connections 2024-09-16T14:41:41.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2166196106 >> 172.21.15.73:0/2166196106 conn(0x7fe4f80b7eb0 msgr2=0x7fe4f806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2166196106 shutdown_connections 2024-09-16T14:41:41.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.416+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2166196106 wait complete. 2024-09-16T14:41:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 Processor -- start 2024-09-16T14:41:41.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 -- start start 2024-09-16T14:41:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f813e2d0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80b2600 con 0x7fe4f806f460 2024-09-16T14:41:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80b2790 con 0x7fe4f8070180 2024-09-16T14:41:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f77fe700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fe4f8070180 0x7fe4f813d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34160/0 (socket says 172.21.15.73:34160) 2024-09-16T14:41:41.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f77fe700 1 -- 172.21.15.73:0/2315254559 learned_addr learned my addr 172.21.15.73:0/2315254559 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187083431 0 0) 0x7fe4f813e2d0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d80035d0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660832535 0 0) 0x7fe4f80b2790 con 0x7fe4f8070180 2024-09-16T14:41:41.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f813e2d0 con 0x7fe4f8070180 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166846496 0 0) 0x7fe4f80b2600 con 0x7fe4f806f460 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f80b2790 con 0x7fe4f806f460 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 31704374 0 0) 0x7fe4d80035d0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe4f80b2600 con 0x7fe4f8141ca0 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe4f0001790 con 0x7fe4f8141ca0 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 34264326 0 0) 0x7fe4f813e2d0 con 0x7fe4f8070180 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe4d80035d0 con 0x7fe4f8070180 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe4e80017b0 con 0x7fe4f8070180 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1068679829 0 0) 0x7fe4f80b2600 con 0x7fe4f8141ca0 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 >> v1:172.21.15.73:6790/0 conn(0x7fe4f8070180 legacy=0x7fe4f813d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 >> v1:172.21.15.177:6789/0 conn(0x7fe4f806f460 legacy=0x7fe4f80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f813e620 con 0x7fe4f8141ca0 2024-09-16T14:41:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f813e8d0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f81e1db0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe4f00019b0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.420+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fe4f00051c0 con 0x7fe4f8141ca0 2024-09-16T14:41:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.424+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc005100 con 0x7fe4f8141ca0 2024-09-16T14:41:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.424+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fe4f001a360 con 0x7fe4f8141ca0 2024-09-16T14:41:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.424+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fe4f007fb20 con 0x7fe4f8141ca0 2024-09-16T14:41:41.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.432+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fe4f004d130 con 0x7fe4f8141ca0 2024-09-16T14:41:41.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.612+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4dc000b90 con 0x7fe4d8067420 2024-09-16T14:41:41.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.612+0000 7fe4f4ff9700 1 -- 172.21.15.73:0/2315254559 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (unknown 3782719169 0 0) 0x7fe4dc000b90 con 0x7fe4d8067420 2024-09-16T14:41:41.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.616+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 >> v1:172.21.15.177:6816/2823028339 conn(0x7fe4d8067420 legacy=0x7fe4d80698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.616+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 >> v1:172.21.15.73:6789/0 conn(0x7fe4f8141ca0 legacy=0x7fe4f813dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.616+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 shutdown_connections 2024-09-16T14:41:41.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.616+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 >> 172.21.15.73:0/2315254559 conn(0x7fe4f80b7eb0 msgr2=0x7fe4f80b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.616+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 shutdown_connections 2024-09-16T14:41:41.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.616+0000 7fe4fd7ac700 1 -- 172.21.15.73:0/2315254559 wait complete. 2024-09-16T14:41:41.622 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T14:41:41.633 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T14:41:41.634 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:41.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd7fff700 1 Processor -- start 2024-09-16T14:41:41.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd7fff700 1 -- start start 2024-09-16T14:41:41.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd7fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd0032620 con 0x7f0cd00067c0 2024-09-16T14:41:41.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd7fff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd0030da0 con 0x7f0cd00063e0 2024-09-16T14:41:41.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd7fff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd00314a0 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd67fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0cd00067c0 0x7f0cd00cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41126/0 (socket says 172.21.15.73:41126) 2024-09-16T14:41:41.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd67fc700 1 -- 172.21.15.73:0/1338659774 learned_addr learned my addr 172.21.15.73:0/1338659774 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd77fe700 1 --1- 172.21.15.73:0/1338659774 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 0x7f0cd00d30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34164/0 (socket says 172.21.15.73:34164) 2024-09-16T14:41:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686500499 0 0) 0x7f0cd00314a0 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc00035d0 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253182590 0 0) 0x7f0cd0032620 con 0x7f0cd00067c0 2024-09-16T14:41:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd00314a0 con 0x7f0cd00067c0 2024-09-16T14:41:41.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3310293899 0 0) 0x7f0cc00035d0 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 >> v1:172.21.15.177:6789/0 conn(0x7f0cd00063e0 legacy=0x7f0cd00be010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 >> v1:172.21.15.73:6789/0 conn(0x7f0cd00067c0 legacy=0x7f0cd00cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0031630 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0ccc001540 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ccc001820 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.756+0000 7f0cd5ffb700 1 -- 172.21.15.73:0/1338659774 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0ccc001bb0 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1338659774 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 legacy=0x7f0cd00d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1338659774 shutdown_connections 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1338659774 >> 172.21.15.73:0/1338659774 conn(0x7f0cd0005510 msgr2=0x7f0cd0005920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1338659774 shutdown_connections 2024-09-16T14:41:41.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1338659774 wait complete. 2024-09-16T14:41:41.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 Processor -- start 2024-09-16T14:41:41.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- start start 2024-09-16T14:41:41.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd015c940 con 0x7f0cd00063e0 2024-09-16T14:41:41.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd00be840 con 0x7f0cd00067c0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd7fff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd00343a0 con 0x7f0cd00cb8b0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd6ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0cd00063e0 0x7f0cd015cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41130/0 (socket says 172.21.15.73:41130) 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.760+0000 7f0cd6ffd700 1 -- 172.21.15.73:0/1649995843 learned_addr learned my addr 172.21.15.73:0/1649995843 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811715412 0 0) 0x7f0cd015c940 con 0x7f0cd00063e0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd77fe700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 legacy=0x7f0cd01673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd77fe700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 legacy=0x7f0cd01673c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd77fe700 1 --1- 172.21.15.73:0/1649995843 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 0x7f0cd01673c0 :-1 s=OPENED pgs=321 cs=1 l=1).handle_message read tag failed 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd77fe700 1 --1- 172.21.15.73:0/1649995843 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 0x7f0cd01673c0 :-1 s=OPENED pgs=321 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc40035d0 con 0x7f0cd00063e0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274022504 0 0) 0x7f0cd00be840 con 0x7f0cd00067c0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd015c940 con 0x7f0cd00067c0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1246210966 0 0) 0x7f0cc40035d0 con 0x7f0cd00063e0 2024-09-16T14:41:41.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0cd00be840 con 0x7f0cd00063e0 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0cd8069410 con 0x7f0cd00063e0 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 906966741 0 0) 0x7f0cd015c940 con 0x7f0cd00067c0 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0cc40035d0 con 0x7f0cd00067c0 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0cc80018b0 con 0x7f0cd00067c0 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1139350894 0 0) 0x7f0cd00be840 con 0x7f0cd00063e0 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.73:6790/0 conn(0x7f0cd00cb8b0 legacy=0x7f0cd01673c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.177:6789/0 conn(0x7f0cd00067c0 legacy=0x7f0cd015d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00c01e0 con 0x7f0cd00063e0 2024-09-16T14:41:41.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd00bd280 con 0x7f0cd00063e0 2024-09-16T14:41:41.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd00c1740 con 0x7f0cd00063e0 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0cd00c8900 con 0x7f0cd00063e0 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0cd804ec70 con 0x7f0cd00063e0 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.764+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f0cd804ef50 con 0x7f0cd00063e0 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.768+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f0cd80008d0 con 0x7f0cd00063e0 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.768+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f0cd80f9400 con 0x7f0cd00063e0 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.768+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.177:6809/702447135 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cc4072cf0 con 0x7f0cc406f080 2024-09-16T14:41:41.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.768+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f0cd80f9840 con 0x7f0cd00063e0 2024-09-16T14:41:41.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.768+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== osd.5 v1:172.21.15.177:6809/702447135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f0cc4072cf0 con 0x7f0cc406f080 2024-09-16T14:41:41.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 --> v1:172.21.15.177:6809/702447135 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0cd0030480 con 0x7f0cc406f080 2024-09-16T14:41:41.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cbf7fe700 1 -- 172.21.15.73:0/1649995843 <== osd.5 v1:172.21.15.177:6809/702447135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f0cd0030480 con 0x7f0cc406f080 2024-09-16T14:41:41.791 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:41.791 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:41.791 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.177:6809/702447135 conn(0x7f0cc406f080 legacy=0x7f0cc40714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.177:6816/2823028339 conn(0x7f0cc40672d0 legacy=0x7f0cc4069790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 >> v1:172.21.15.73:6789/0 conn(0x7f0cd00063e0 legacy=0x7f0cd015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd77fe700 1 -- 172.21.15.73:0/1649995843 reap_dead start 2024-09-16T14:41:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 shutdown_connections 2024-09-16T14:41:41.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 >> 172.21.15.73:0/1649995843 conn(0x7f0cd0005510 msgr2=0x7f0cd003c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.784+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 shutdown_connections 2024-09-16T14:41:41.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.788+0000 7f0cd7fff700 1 -- 172.21.15.73:0/1649995843 wait complete. 2024-09-16T14:41:41.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T14:41:41.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.908+0000 7fdfcb49a700 1 Processor -- start 2024-09-16T14:41:41.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.908+0000 7fdfcb49a700 1 -- start start 2024-09-16T14:41:41.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.908+0000 7fdfcb49a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc406b0c0 con 0x7fdfc406f110 2024-09-16T14:41:41.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.908+0000 7fdfcb49a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc406fcf0 con 0x7fdfc406ace0 2024-09-16T14:41:41.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.908+0000 7fdfcb49a700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc41454a0 con 0x7fdfc4140c50 2024-09-16T14:41:41.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9c97700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fdfc4140c50 0x7fdfc4144680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34172/0 (socket says 172.21.15.73:34172) 2024-09-16T14:41:41.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9c97700 1 -- 172.21.15.73:0/3342082354 learned_addr learned my addr 172.21.15.73:0/3342082354 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288936519 0 0) 0x7fdfc41454a0 con 0x7fdfc4140c50 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb00035d0 con 0x7fdfc4140c50 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388551442 0 0) 0x7fdfc406b0c0 con 0x7fdfc406f110 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc41454a0 con 0x7fdfc406f110 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298789132 0 0) 0x7fdfb00035d0 con 0x7fdfc4140c50 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 >> v1:172.21.15.177:6789/0 conn(0x7fdfc406ace0 legacy=0x7fdfc4140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 >> v1:172.21.15.73:6789/0 conn(0x7fdfc406f110 legacy=0x7fdfc4144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc40710c0 con 0x7fdfc4140c50 2024-09-16T14:41:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fdfbc001990 con 0x7fdfc4140c50 2024-09-16T14:41:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdfbc001c70 con 0x7fdfc4140c50 2024-09-16T14:41:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.912+0000 7fdfc9496700 1 -- 172.21.15.73:0/3342082354 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fdfbc002000 con 0x7fdfc4140c50 2024-09-16T14:41:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3342082354 >> v1:172.21.15.73:6790/0 conn(0x7fdfc4140c50 legacy=0x7fdfc4144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3342082354 shutdown_connections 2024-09-16T14:41:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3342082354 >> 172.21.15.73:0/3342082354 conn(0x7fdfc40b57c0 msgr2=0x7fdfc406a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3342082354 shutdown_connections 2024-09-16T14:41:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3342082354 wait complete. 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 Processor -- start 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- start start 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc4146ae0 con 0x7fdfc4140c50 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc4146dc0 con 0x7fdfc406f110 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfcb49a700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc413bf50 con 0x7fdfc406ace0 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfca498700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fdfc406ace0 0x7fdfc4145c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34184/0 (socket says 172.21.15.73:34184) 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfca498700 1 -- 172.21.15.73:0/3928265628 learned_addr learned my addr 172.21.15.73:0/3928265628 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649227851 0 0) 0x7fdfc4146ae0 con 0x7fdfc4140c50 2024-09-16T14:41:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa80035d0 con 0x7fdfc4140c50 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879200442 0 0) 0x7fdfc413bf50 con 0x7fdfc406ace0 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc4146ae0 con 0x7fdfc406ace0 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738597976 0 0) 0x7fdfc4146dc0 con 0x7fdfc406f110 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc413bf50 con 0x7fdfc406f110 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3396767923 0 0) 0x7fdfc4146ae0 con 0x7fdfc406ace0 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdfc4146dc0 con 0x7fdfc406ace0 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fdfc0001860 con 0x7fdfc406ace0 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2623229947 0 0) 0x7fdfa80035d0 con 0x7fdfc4140c50 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdfc4146ae0 con 0x7fdfc4140c50 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.916+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fdfb40018b0 con 0x7fdfc4140c50 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 332738933 0 0) 0x7fdfc4146dc0 con 0x7fdfc406ace0 2024-09-16T14:41:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 >> v1:172.21.15.177:6789/0 conn(0x7fdfc406f110 legacy=0x7fdfc413b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 >> v1:172.21.15.73:6789/0 conn(0x7fdfc4140c50 legacy=0x7fdfc413b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc41481d0 con 0x7fdfc406ace0 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc40affe0 con 0x7fdfc406ace0 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc41e2260 con 0x7fdfc406ace0 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdfc00036c0 con 0x7fdfc406ace0 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fdfc0003a50 con 0x7fdfc406ace0 2024-09-16T14:41:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fdfc0003c30 con 0x7fdfc406ace0 2024-09-16T14:41:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fdfc007f610 con 0x7fdfc406ace0 2024-09-16T14:41:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.920+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac005100 con 0x7fdfc406ace0 2024-09-16T14:41:41.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:41.928+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fdfc004cd60 con 0x7fdfc406ace0 2024-09-16T14:41:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.096+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfac000b90 con 0x7fdfa8067380 2024-09-16T14:41:42.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfbaffd700 1 -- 172.21.15.73:0/3928265628 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (unknown 2264484800 0 0) 0x7fdfac000b90 con 0x7fdfa8067380 2024-09-16T14:41:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 >> v1:172.21.15.177:6816/2823028339 conn(0x7fdfa8067380 legacy=0x7fdfa8069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 >> v1:172.21.15.73:6790/0 conn(0x7fdfc406ace0 legacy=0x7fdfc4145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 shutdown_connections 2024-09-16T14:41:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 >> 172.21.15.73:0/3928265628 conn(0x7fdfc40b57c0 msgr2=0x7fdfc414d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 shutdown_connections 2024-09-16T14:41:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.100+0000 7fdfcb49a700 1 -- 172.21.15.73:0/3928265628 wait complete. 2024-09-16T14:41:42.108 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T14:41:42.119 INFO:tasks.ceph:Scrubbing osd.6 2024-09-16T14:41:42.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:42.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f827dde6700 1 Processor -- start 2024-09-16T14:41:42.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f827dde6700 1 -- start start 2024-09-16T14:41:42.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f827dde6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8278141720 con 0x7f82780af020 2024-09-16T14:41:42.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f827dde6700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827806e970 con 0x7f82780aec40 2024-09-16T14:41:42.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f827dde6700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827806d130 con 0x7f827813b2f0 2024-09-16T14:41:42.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f8277fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f82780af020 0x7f827813abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41156/0 (socket says 172.21.15.73:41156) 2024-09-16T14:41:42.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f827d5e5700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f827813b2f0 0x7f827814ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34190/0 (socket says 172.21.15.73:34190) 2024-09-16T14:41:42.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f8277fff700 1 -- 172.21.15.73:0/2790973779 learned_addr learned my addr 172.21.15.73:0/2790973779 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392683237 0 0) 0x7f8278141720 con 0x7f82780af020 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82680035d0 con 0x7f82780af020 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741515823 0 0) 0x7f827806d130 con 0x7f827813b2f0 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8278141720 con 0x7f827813b2f0 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552906648 0 0) 0x7f827806e970 con 0x7f82780aec40 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827806d130 con 0x7f82780aec40 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529316439 0 0) 0x7f82680035d0 con 0x7f82780af020 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 >> v1:172.21.15.73:6790/0 conn(0x7f827813b2f0 legacy=0x7f827814ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 >> v1:172.21.15.177:6789/0 conn(0x7f82780aec40 legacy=0x7f82780ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780acf70 con 0x7f82780af020 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f826c001610 con 0x7f82780af020 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f826c0018f0 con 0x7f82780af020 2024-09-16T14:41:42.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.232+0000 7f82777fe700 1 -- 172.21.15.73:0/2790973779 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f826c001c80 con 0x7f82780af020 2024-09-16T14:41:42.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- 172.21.15.73:0/2790973779 >> v1:172.21.15.73:6789/0 conn(0x7f82780af020 legacy=0x7f827813abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- 172.21.15.73:0/2790973779 shutdown_connections 2024-09-16T14:41:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- 172.21.15.73:0/2790973779 >> 172.21.15.73:0/2790973779 conn(0x7f82780af860 msgr2=0x7f82780afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- 172.21.15.73:0/2790973779 shutdown_connections 2024-09-16T14:41:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- 172.21.15.73:0/2790973779 wait complete. 2024-09-16T14:41:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 Processor -- start 2024-09-16T14:41:42.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- start start 2024-09-16T14:41:42.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827813cf30 con 0x7f82780aec40 2024-09-16T14:41:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8278070640 con 0x7f827813b2f0 2024-09-16T14:41:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827dde6700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827813e890 con 0x7f82780af020 2024-09-16T14:41:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827cde4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f82780aec40 0x7f82781d66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41158/0 (socket says 172.21.15.73:41158) 2024-09-16T14:41:42.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f827cde4700 1 -- 172.21.15.73:0/970492098 learned_addr learned my addr 172.21.15.73:0/970492098 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013569902 0 0) 0x7f827813cf30 con 0x7f82780aec40 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.236+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f825c0035d0 con 0x7f82780aec40 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2015763344 0 0) 0x7f825c0035d0 con 0x7f82780aec40 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f827813cf30 con 0x7f82780aec40 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584758130 0 0) 0x7f827813e890 con 0x7f82780af020 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f825c0035d0 con 0x7f82780af020 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f82640019d0 con 0x7f82780aec40 2024-09-16T14:41:42.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128109737 0 0) 0x7f8278070640 con 0x7f827813b2f0 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827813e890 con 0x7f827813b2f0 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2912210550 0 0) 0x7f827813cf30 con 0x7f82780aec40 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 >> v1:172.21.15.73:6790/0 conn(0x7f82780af020 legacy=0x7f827813dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 >> v1:172.21.15.177:6789/0 conn(0x7f827813b2f0 legacy=0x7f82781e1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827813d6a0 con 0x7f82780aec40 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82781d5fd0 con 0x7f82780aec40 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f82781d6fd0 con 0x7f82780aec40 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8264001c00 con 0x7f82780aec40 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8264003b10 con 0x7f82780aec40 2024-09-16T14:41:42.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.73:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8258000f10 con 0x7f82780aec40 2024-09-16T14:41:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f8264003cf0 con 0x7f82780aec40 2024-09-16T14:41:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f826407f760 con 0x7f82780aec40 2024-09-16T14:41:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.177:6800/877193733 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f825c072d00 con 0x7f825c06f090 2024-09-16T14:41:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.240+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f826407fbc0 con 0x7f82780aec40 2024-09-16T14:41:42.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.244+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== osd.6 v1:172.21.15.177:6800/877193733 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f825c072d00 con 0x7f825c06f090 2024-09-16T14:41:42.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.260+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 --> v1:172.21.15.177:6800/877193733 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8258002c00 con 0x7f825c06f090 2024-09-16T14:41:42.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f82757fa700 1 -- 172.21.15.73:0/970492098 <== osd.6 v1:172.21.15.177:6800/877193733 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f8258002c00 con 0x7f825c06f090 2024-09-16T14:41:42.268 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:42.268 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:42.268 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:42.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 >> v1:172.21.15.177:6800/877193733 conn(0x7f825c06f090 legacy=0x7f825c0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 >> v1:172.21.15.177:6816/2823028339 conn(0x7f825c0672e0 legacy=0x7f825c0697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 >> v1:172.21.15.73:6789/0 conn(0x7f82780aec40 legacy=0x7f82781d66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827d5e5700 1 -- 172.21.15.73:0/970492098 reap_dead start 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 shutdown_connections 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 >> 172.21.15.73:0/970492098 conn(0x7f82780af860 msgr2=0x7f82780ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 shutdown_connections 2024-09-16T14:41:42.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.264+0000 7f827dde6700 1 -- 172.21.15.73:0/970492098 wait complete. 2024-09-16T14:41:42.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-16T14:41:42.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb50186c700 1 Processor -- start 2024-09-16T14:41:42.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb50186c700 1 -- start start 2024-09-16T14:41:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb50186c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc13f130 con 0x7fb4fc13ec30 2024-09-16T14:41:42.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb50186c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0b5ca0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb50186c700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0a9eb0 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb4fbfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb4fc13ec30 0x7fb4fc142990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41160/0 (socket says 172.21.15.73:41160) 2024-09-16T14:41:42.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.396+0000 7fb4fbfff700 1 -- 172.21.15.73:0/841393428 learned_addr learned my addr 172.21.15.73:0/841393428 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819999884 0 0) 0x7fb4fc13f130 con 0x7fb4fc13ec30 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec0035d0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244101807 0 0) 0x7fb4fc0a9eb0 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4fc13f130 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462391277 0 0) 0x7fb4fc0b5ca0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4fc0a9eb0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318386282 0 0) 0x7fb4fc13f130 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 >> v1:172.21.15.177:6789/0 conn(0x7fb4fc1430a0 legacy=0x7fb4fc14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 >> v1:172.21.15.73:6789/0 conn(0x7fb4fc13ec30 legacy=0x7fb4fc142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0718d0 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb4f0001590 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb4f00017b0 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb4fb7fe700 1 -- 172.21.15.73:0/841393428 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb4f0001b80 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 -- 172.21.15.73:0/841393428 >> v1:172.21.15.73:6790/0 conn(0x7fb4fc0b58c0 legacy=0x7fb4fc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 -- 172.21.15.73:0/841393428 shutdown_connections 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 -- 172.21.15.73:0/841393428 >> 172.21.15.73:0/841393428 conn(0x7fb4fc06aaf0 msgr2=0x7fb4fc0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 -- 172.21.15.73:0/841393428 shutdown_connections 2024-09-16T14:41:42.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 -- 172.21.15.73:0/841393428 wait complete. 2024-09-16T14:41:42.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 Processor -- start 2024-09-16T14:41:42.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.400+0000 7fb50186c700 1 -- start start 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb50186c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc1362c0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb50186c700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc141120 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb50186c700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc1412b0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4fbfff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fb4fc13ec30 0x7fb4fc1d3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34226/0 (socket says 172.21.15.73:34226) 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4fbfff700 1 -- 172.21.15.73:0/3652161596 learned_addr learned my addr 172.21.15.73:0/3652161596 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441252725 0 0) 0x7fb4fc1362c0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e00035d0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747796661 0 0) 0x7fb4fc1412b0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4fc1362c0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 235522299 0 0) 0x7fb4fc1362c0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb4fc1412b0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb4e80019f0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403728729 0 0) 0x7fb4fc141120 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4fc1362c0 con 0x7fb4fc0b58c0 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 66743279 0 0) 0x7fb4e00035d0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb4fc141120 con 0x7fb4fc1430a0 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb4f4001ad0 con 0x7fb4fc1430a0 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 970105828 0 0) 0x7fb4fc1412b0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 >> v1:172.21.15.177:6789/0 conn(0x7fb4fc0b58c0 legacy=0x7fb4fc141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 >> v1:172.21.15.73:6789/0 conn(0x7fb4fc1430a0 legacy=0x7fb4fc1d4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc1d7ef0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc138c60 con 0x7fb4fc13ec30 2024-09-16T14:41:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc1421e0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb4e8001c60 con 0x7fb4fc13ec30 2024-09-16T14:41:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fb4e8004ce0 con 0x7fb4fc13ec30 2024-09-16T14:41:42.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.404+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc1d8140 con 0x7fb4fc13ec30 2024-09-16T14:41:42.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.408+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fb4e8019e80 con 0x7fb4fc13ec30 2024-09-16T14:41:42.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.408+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fb4e807f790 con 0x7fb4fc13ec30 2024-09-16T14:41:42.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.416+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fb4e804cd30 con 0x7fb4fc13ec30 2024-09-16T14:41:42.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.612+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4fc141440 con 0x7fb4e0067380 2024-09-16T14:41:42.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.612+0000 7fb4f97fa700 1 -- 172.21.15.73:0/3652161596 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (unknown 778718403 0 0) 0x7fb4fc141440 con 0x7fb4e0067380 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.612+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 >> v1:172.21.15.177:6816/2823028339 conn(0x7fb4e0067380 legacy=0x7fb4e0069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.612+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 >> v1:172.21.15.73:6790/0 conn(0x7fb4fc13ec30 legacy=0x7fb4fc1d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.616+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 shutdown_connections 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.616+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 >> 172.21.15.73:0/3652161596 conn(0x7fb4fc06aaf0 msgr2=0x7fb4fc06f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.616+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 shutdown_connections 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.616+0000 7fb50186c700 1 -- 172.21.15.73:0/3652161596 wait complete. 2024-09-16T14:41:42.621 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-09-16T14:41:42.632 INFO:tasks.ceph:Scrubbing osd.7 2024-09-16T14:41:42.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-16T14:41:42.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57dfdf1700 1 Processor -- start 2024-09-16T14:41:42.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57dfdf1700 1 -- start start 2024-09-16T14:41:42.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57dfdf1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d806b110 con 0x7f57d8140db0 2024-09-16T14:41:42.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57dfdf1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d8071400 con 0x7f57d806ad30 2024-09-16T14:41:42.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57dfdf1700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d8070500 con 0x7f57d8070070 2024-09-16T14:41:42.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57de38e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f57d8140db0 0x7f57d814cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41180/0 (socket says 172.21.15.73:41180) 2024-09-16T14:41:42.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57dd38c700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f57d8070070 0x7f57d8144cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34228/0 (socket says 172.21.15.73:34228) 2024-09-16T14:41:42.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.744+0000 7f57de38e700 1 -- 172.21.15.73:0/2492545819 learned_addr learned my addr 172.21.15.73:0/2492545819 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797063792 0 0) 0x7f57d8070500 con 0x7f57d8070070 2024-09-16T14:41:42.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c40035d0 con 0x7f57d8070070 2024-09-16T14:41:42.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371935014 0 0) 0x7f57d806b110 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d8070500 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690652236 0 0) 0x7f57d8071400 con 0x7f57d806ad30 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d806b110 con 0x7f57d806ad30 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1379321520 0 0) 0x7f57d8070500 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 >> v1:172.21.15.73:6790/0 conn(0x7f57d8070070 legacy=0x7f57d8144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 >> v1:172.21.15.177:6789/0 conn(0x7f57d806ad30 legacy=0x7f57d81406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8141350 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f57d0001970 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f57d0001c90 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dcb8b700 1 -- 172.21.15.73:0/2492545819 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f57d0002020 con 0x7f57d8140db0 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 -- 172.21.15.73:0/2492545819 >> v1:172.21.15.73:6789/0 conn(0x7f57d8140db0 legacy=0x7f57d814cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 -- 172.21.15.73:0/2492545819 shutdown_connections 2024-09-16T14:41:42.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 -- 172.21.15.73:0/2492545819 >> 172.21.15.73:0/2492545819 conn(0x7f57d80b7c70 msgr2=0x7f57d806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 -- 172.21.15.73:0/2492545819 shutdown_connections 2024-09-16T14:41:42.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 -- 172.21.15.73:0/2492545819 wait complete. 2024-09-16T14:41:42.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 Processor -- start 2024-09-16T14:41:42.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.748+0000 7f57dfdf1700 1 -- start start 2024-09-16T14:41:42.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57dfdf1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d813b980 con 0x7f57d806ad30 2024-09-16T14:41:42.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57dfdf1700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d813bb10 con 0x7f57d8140db0 2024-09-16T14:41:42.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57dfdf1700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d81369b0 con 0x7f57d8070070 2024-09-16T14:41:42.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ddb8d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f57d806ad30 0x7f57d813b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41196/0 (socket says 172.21.15.73:41196) 2024-09-16T14:41:42.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ddb8d700 1 -- 172.21.15.73:0/681392580 learned_addr learned my addr 172.21.15.73:0/681392580 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100764160 0 0) 0x7f57d813b980 con 0x7f57d806ad30 2024-09-16T14:41:42.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57bc0035d0 con 0x7f57d806ad30 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937623326 0 0) 0x7f57d81369b0 con 0x7f57d8070070 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d813b980 con 0x7f57d8070070 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4098247886 0 0) 0x7f57d813b980 con 0x7f57d8070070 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f57d81369b0 con 0x7f57d8070070 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f57d4001b50 con 0x7f57d8070070 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2635498146 0 0) 0x7f57bc0035d0 con 0x7f57d806ad30 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f57d813b980 con 0x7f57d806ad30 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347608385 0 0) 0x7f57d813bb10 con 0x7f57d8140db0 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57bc0035d0 con 0x7f57d8140db0 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f57c8001830 con 0x7f57d806ad30 2024-09-16T14:41:42.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2293698836 0 0) 0x7f57d81369b0 con 0x7f57d8070070 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 >> v1:172.21.15.177:6789/0 conn(0x7f57d8140db0 legacy=0x7f57d81e0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 >> v1:172.21.15.73:6789/0 conn(0x7f57d806ad30 legacy=0x7f57d813b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d8136b40 con 0x7f57d8070070 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d813c9b0 con 0x7f57d8070070 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d813eb20 con 0x7f57d8070070 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f57d4001000 con 0x7f57d8070070 2024-09-16T14:41:42.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.752+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f57d4004ce0 con 0x7f57d8070070 2024-09-16T14:41:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.756+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.73:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57c0000f10 con 0x7f57d8070070 2024-09-16T14:41:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.756+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f57d4019f00 con 0x7f57d8070070 2024-09-16T14:41:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.756+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f57d407f6b0 con 0x7f57d8070070 2024-09-16T14:41:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.756+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.177:6808/3844040909 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57bc072ce0 con 0x7f57bc06f110 2024-09-16T14:41:42.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.756+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (unknown 1823520817 0 0) 0x7f57d407fae0 con 0x7f57d8070070 2024-09-16T14:41:42.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.760+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== osd.7 v1:172.21.15.177:6808/3844040909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (unknown 0 0 1686565167) 0x7f57bc072ce0 con 0x7f57bc06f110 2024-09-16T14:41:42.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.776+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 --> v1:172.21.15.177:6808/3844040909 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57c0002c00 con 0x7f57bc06f110 2024-09-16T14:41:42.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57ce7fc700 1 -- 172.21.15.73:0/681392580 <== osd.7 v1:172.21.15.177:6808/3844040909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f57c0002c00 con 0x7f57bc06f110 2024-09-16T14:41:42.785 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-16T14:41:42.785 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T14:41:42.785 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-16T14:41:42.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 >> v1:172.21.15.177:6808/3844040909 conn(0x7f57bc06f110 legacy=0x7f57bc071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 >> v1:172.21.15.177:6816/2823028339 conn(0x7f57bc067360 legacy=0x7f57bc069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 >> v1:172.21.15.73:6790/0 conn(0x7f57d8070070 legacy=0x7f57d813e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57de38e700 1 -- 172.21.15.73:0/681392580 reap_dead start 2024-09-16T14:41:42.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 shutdown_connections 2024-09-16T14:41:42.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 >> 172.21.15.73:0/681392580 conn(0x7f57d80b7c70 msgr2=0x7f57d80b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 shutdown_connections 2024-09-16T14:41:42.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.780+0000 7f57dfdf1700 1 -- 172.21.15.73:0/681392580 wait complete. 2024-09-16T14:41:42.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-16T14:41:42.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 Processor -- start 2024-09-16T14:41:42.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- start start 2024-09-16T14:41:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc13f6f0 con 0x7f3bdc13ef90 2024-09-16T14:41:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc071120 con 0x7f3bdc0a8910 2024-09-16T14:41:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc06d630 con 0x7f3bdc070d40 2024-09-16T14:41:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be0c18700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 0x7f3bdc13fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34246/0 (socket says 172.21.15.73:34246) 2024-09-16T14:41:42.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be0c18700 1 -- 172.21.15.73:0/3241433913 learned_addr learned my addr 172.21.15.73:0/3241433913 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357766452 0 0) 0x7f3bdc06d630 con 0x7f3bdc070d40 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc40035d0 con 0x7f3bdc070d40 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427227491 0 0) 0x7f3bdc13f6f0 con 0x7f3bdc13ef90 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc06d630 con 0x7f3bdc13ef90 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560496833 0 0) 0x7f3bdc071120 con 0x7f3bdc0a8910 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc13f6f0 con 0x7f3bdc0a8910 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609067794 0 0) 0x7f3bdc06d630 con 0x7f3bdc13ef90 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 legacy=0x7f3bdc13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 >> v1:172.21.15.177:6789/0 conn(0x7f3bdc0a8910 legacy=0x7f3bdc06cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0a8e50 con 0x7f3bdc13ef90 2024-09-16T14:41:42.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3bd4001570 con 0x7f3bdc13ef90 2024-09-16T14:41:42.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3bd4001810 con 0x7f3bdc13ef90 2024-09-16T14:41:42.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3bdb7fe700 1 -- 172.21.15.73:0/3241433913 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3bd4001be0 con 0x7f3bdc13ef90 2024-09-16T14:41:42.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- 172.21.15.73:0/3241433913 >> v1:172.21.15.73:6789/0 conn(0x7f3bdc13ef90 legacy=0x7f3bdc13e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- 172.21.15.73:0/3241433913 shutdown_connections 2024-09-16T14:41:42.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- 172.21.15.73:0/3241433913 >> 172.21.15.73:0/3241433913 conn(0x7f3bdc06a360 msgr2=0x7f3bdc06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:42.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- 172.21.15.73:0/3241433913 shutdown_connections 2024-09-16T14:41:42.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.920+0000 7f3be1c1a700 1 -- 172.21.15.73:0/3241433913 wait complete. 2024-09-16T14:41:42.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 Processor -- start 2024-09-16T14:41:42.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 -- start start 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0ab070 con 0x7f3bdc13ef90 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0af000 con 0x7f3bdc0a8910 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0af190 con 0x7f3bdc070d40 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be0c18700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 0x7f3bdc136070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:34258/0 (socket says 172.21.15.73:34258) 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be0c18700 1 -- 172.21.15.73:0/298518359 learned_addr learned my addr 172.21.15.73:0/298518359 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1419700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3bdc13ef90 0x7f3bdc1df5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41212/0 (socket says 172.21.15.73:41212) 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859426687 0 0) 0x7f3bdc0ab070 con 0x7f3bdc13ef90 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be0c18700 1 -- 172.21.15.73:0/298518359 >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 legacy=0x7f3bdc136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be0c18700 1 -- 172.21.15.73:0/298518359 >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 legacy=0x7f3bdc136070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be0c18700 1 --1- 172.21.15.73:0/298518359 >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 0x7f3bdc136070 :-1 s=OPENED pgs=331 cs=1 l=1).handle_message read tag failed 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be0c18700 1 --1- 172.21.15.73:0/298518359 >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 0x7f3bdc136070 :-1 s=OPENED pgs=331 cs=1 l=1).fault on lossy channel, failing 2024-09-16T14:41:42.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc80035d0 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909437863 0 0) 0x7f3bdc0af000 con 0x7f3bdc0a8910 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc0ab070 con 0x7f3bdc0a8910 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1331452963 0 0) 0x7f3bc80035d0 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3bdc0af000 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3bd4001b20 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1444906820 0 0) 0x7f3bdc0af000 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 >> v1:172.21.15.73:6790/0 conn(0x7f3bdc070d40 legacy=0x7f3bdc136070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 >> v1:172.21.15.177:6789/0 conn(0x7f3bdc0a8910 legacy=0x7f3bdc1d3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0af320 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc136780 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc0aa540 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3bd4003950 con 0x7f3bdc13ef90 2024-09-16T14:41:42.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.924+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f3bd4003ce0 con 0x7f3bdc13ef90 2024-09-16T14:41:42.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.928+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc005100 con 0x7f3bdc13ef90 2024-09-16T14:41:42.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.928+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f3bd4003e40 con 0x7f3bdc13ef90 2024-09-16T14:41:42.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.928+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f3bd407f760 con 0x7f3bdc13ef90 2024-09-16T14:41:42.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:42.932+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f3bd404cba0 con 0x7f3bdc13ef90 2024-09-16T14:41:43.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.100+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bbc000b90 con 0x7f3bc8066ff0 2024-09-16T14:41:43.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.100+0000 7f3bd97fa700 1 -- 172.21.15.73:0/298518359 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (unknown 1239724482 0 0) 0x7f3bbc000b90 con 0x7f3bc8066ff0 2024-09-16T14:41:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.104+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 >> v1:172.21.15.177:6816/2823028339 conn(0x7f3bc8066ff0 legacy=0x7f3bc80694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.104+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 >> v1:172.21.15.73:6789/0 conn(0x7f3bdc13ef90 legacy=0x7f3bdc1df5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.104+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 shutdown_connections 2024-09-16T14:41:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.104+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 >> 172.21.15.73:0/298518359 conn(0x7f3bdc06a360 msgr2=0x7f3bdc13bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.104+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 shutdown_connections 2024-09-16T14:41:43.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.104+0000 7f3be1c1a700 1 -- 172.21.15.73:0/298518359 wait complete. 2024-09-16T14:41:43.111 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-09-16T14:41:43.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:41:43.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.228+0000 7f4543227700 1 Processor -- start 2024-09-16T14:41:43.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.228+0000 7f4543227700 1 -- start start 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340303b0 con 0x7f45340c5190 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453402aac0 con 0x7f453402f7d0 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4534028a90 con 0x7f453402ffd0 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4542a26700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f45340c5190 0x7f45340d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41220/0 (socket says 172.21.15.73:41220) 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4542a26700 1 -- 172.21.15.73:0/372064726 learned_addr learned my addr 172.21.15.73:0/372064726 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100367419 0 0) 0x7f45340303b0 con 0x7f45340c5190 2024-09-16T14:41:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45280035d0 con 0x7f45340c5190 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677755195 0 0) 0x7f4534028a90 con 0x7f453402ffd0 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45340303b0 con 0x7f453402ffd0 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683473153 0 0) 0x7f453402aac0 con 0x7f453402f7d0 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4534028a90 con 0x7f453402f7d0 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 416922730 0 0) 0x7f45280035d0 con 0x7f45340c5190 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 >> v1:172.21.15.73:6790/0 conn(0x7f453402ffd0 legacy=0x7f45340c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 >> v1:172.21.15.177:6789/0 conn(0x7f453402f7d0 legacy=0x7f45340c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340c9230 con 0x7f45340c5190 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f453c069410 con 0x7f45340c5190 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f453c04ec70 con 0x7f45340c5190 2024-09-16T14:41:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4541223700 1 -- 172.21.15.73:0/372064726 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f453c04ef50 con 0x7f45340c5190 2024-09-16T14:41:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- 172.21.15.73:0/372064726 >> v1:172.21.15.73:6789/0 conn(0x7f45340c5190 legacy=0x7f45340d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- 172.21.15.73:0/372064726 shutdown_connections 2024-09-16T14:41:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- 172.21.15.73:0/372064726 >> 172.21.15.73:0/372064726 conn(0x7f4534039730 msgr2=0x7f45340357a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- 172.21.15.73:0/372064726 shutdown_connections 2024-09-16T14:41:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.232+0000 7f4543227700 1 -- 172.21.15.73:0/372064726 wait complete. 2024-09-16T14:41:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4543227700 1 Processor -- start 2024-09-16T14:41:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4543227700 1 -- start start 2024-09-16T14:41:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4543227700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453415e8d0 con 0x7f45340c5190 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4543227700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340be020 con 0x7f453402f7d0 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4543227700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340be1b0 con 0x7f453402ffd0 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4542a26700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f45340c5190 0x7f4534164db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41236/0 (socket says 172.21.15.73:41236) 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f4542a26700 1 -- 172.21.15.73:0/3759802287 learned_addr learned my addr 172.21.15.73:0/3759802287 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184800573 0 0) 0x7f453415e8d0 con 0x7f45340c5190 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45200035d0 con 0x7f45340c5190 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225978168 0 0) 0x7f45340be1b0 con 0x7f453402ffd0 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f453415e8d0 con 0x7f453402ffd0 2024-09-16T14:41:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892390502 0 0) 0x7f45340be020 con 0x7f453402f7d0 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45340be1b0 con 0x7f453402f7d0 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2843607854 0 0) 0x7f453415e8d0 con 0x7f453402ffd0 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45340be020 con 0x7f453402ffd0 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f4530001870 con 0x7f453402ffd0 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3455364622 0 0) 0x7f45200035d0 con 0x7f45340c5190 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f453415e8d0 con 0x7f45340c5190 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f453c069410 con 0x7f45340c5190 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.236+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2576770841 0 0) 0x7f45340be020 con 0x7f453402ffd0 2024-09-16T14:41:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 >> v1:172.21.15.177:6789/0 conn(0x7f453402f7d0 legacy=0x7f45340bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 >> v1:172.21.15.73:6789/0 conn(0x7f45340c5190 legacy=0x7f4534164db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340be340 con 0x7f453402ffd0 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45340c8130 con 0x7f453402ffd0 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f453415e270 con 0x7f453402ffd0 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f45300036c0 con 0x7f453402ffd0 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f4530003a50 con 0x7f453402ffd0 2024-09-16T14:41:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4524005100 con 0x7f453402ffd0 2024-09-16T14:41:43.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f4530003bb0 con 0x7f453402ffd0 2024-09-16T14:41:43.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.240+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f453007e540 con 0x7f453402ffd0 2024-09-16T14:41:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.248+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f453004bb50 con 0x7f453402ffd0 2024-09-16T14:41:43.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.428+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4524000b90 con 0x7f4520067310 2024-09-16T14:41:43.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.436+0000 7f452effd700 1 -- 172.21.15.73:0/3759802287 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+152772 (unknown 2965378022 0 2812297480) 0x7f4524000b90 con 0x7f4520067310 2024-09-16T14:41:43.444 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:41:43.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.444+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 >> v1:172.21.15.177:6816/2823028339 conn(0x7f4520067310 legacy=0x7f45200697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.444+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 >> v1:172.21.15.73:6790/0 conn(0x7f453402ffd0 legacy=0x7f453415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:41:43.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.444+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 shutdown_connections 2024-09-16T14:41:43.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.444+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 >> 172.21.15.73:0/3759802287 conn(0x7f4534039730 msgr2=0x7f45340c1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:41:43.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.444+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 shutdown_connections 2024-09-16T14:41:43.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:41:43.444+0000 7f4543227700 1 -- 172.21.15.73:0/3759802287 wait complete. 2024-09-16T14:41:43.452 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:41:43.463 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-16T14:41:43.229072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3549045547,"num_objects":877,"num_object_clones":0,"num_object_copies":1754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":2679,"num_read_kb":2679,"num_write":150911,"num_write_kb":5603095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152687,"ondisk_log_size":152687,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8861152,"kb_used_data":6623300,"kb_used_omap":12,"kb_used_meta":2237747,"kb_avail":746113568,"statfs":{"total":773094113280,"available":764020293632,"internally_reserved":0,"allocated":6782259200,"data_stored":6797250362,"data_compressed":70427572,"data_compressed_allocated":73408512,"data_compressed_original":93880320,"omap_allocated":12744,"internal_metadata":2291453496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8720,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":66,"num_read_kb":71,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003278"},"pg_stats":[{"pgid":"3.1f","version":"22'4440","reported_seq":4492,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:37.384128+0000","last_change":"2024-09-16T14:37:24.064528+0000","last_active":"2024-09-16T14:41:37.384128+0000","last_peered":"2024-09-16T14:41:37.384128+0000","last_clean":"2024-09-16T14:41:37.384128+0000","last_became_active":"2024-09-16T14:37:24.063684+0000","last_became_peered":"2024-09-16T14:37:24.063684+0000","last_unstale":"2024-09-16T14:41:37.384128+0000","last_undegraded":"2024-09-16T14:41:37.384128+0000","last_fullsized":"2024-09-16T14:41:37.384128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137234784,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":140,"num_read_kb":116,"num_write":4501,"num_write_kb":200999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'6687","reported_seq":6709,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.388642+0000","last_change":"2024-09-16T14:37:23.861741+0000","last_active":"2024-09-16T14:41:36.388642+0000","last_peered":"2024-09-16T14:41:36.388642+0000","last_clean":"2024-09-16T14:41:36.388642+0000","last_became_active":"2024-09-16T14:37:23.861295+0000","last_became_peered":"2024-09-16T14:37:23.861295+0000","last_unstale":"2024-09-16T14:41:36.388642+0000","last_undegraded":"2024-09-16T14:41:36.388642+0000","last_fullsized":"2024-09-16T14:41:36.388642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6687,"log_dups_size":0,"ondisk_log_size":6687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6680,"num_write_kb":211796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'6872","reported_seq":6900,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.388012+0000","last_change":"2024-09-16T14:37:23.875435+0000","last_active":"2024-09-16T14:41:36.388012+0000","last_peered":"2024-09-16T14:41:36.388012+0000","last_clean":"2024-09-16T14:41:36.388012+0000","last_became_active":"2024-09-16T14:37:23.875180+0000","last_became_peered":"2024-09-16T14:37:23.875180+0000","last_unstale":"2024-09-16T14:41:36.388012+0000","last_undegraded":"2024-09-16T14:41:36.388012+0000","last_fullsized":"2024-09-16T14:41:36.388012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6872,"log_dups_size":0,"ondisk_log_size":6872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":56,"num_read_kb":105,"num_write":6978,"num_write_kb":205252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"22'4530","reported_seq":4549,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:20.938954+0000","last_change":"2024-09-16T14:37:23.875704+0000","last_active":"2024-09-16T14:40:20.938954+0000","last_peered":"2024-09-16T14:40:20.938954+0000","last_clean":"2024-09-16T14:40:20.938954+0000","last_became_active":"2024-09-16T14:37:23.875445+0000","last_became_peered":"2024-09-16T14:37:23.875445+0000","last_unstale":"2024-09-16T14:40:20.938954+0000","last_undegraded":"2024-09-16T14:40:20.938954+0000","last_fullsized":"2024-09-16T14:40:20.938954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4530,"log_dups_size":0,"ondisk_log_size":4530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:02:46.065208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113247232,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4552,"num_write_kb":157847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'6413","reported_seq":6435,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.390622+0000","last_change":"2024-09-16T14:37:23.873790+0000","last_active":"2024-09-16T14:41:36.390622+0000","last_peered":"2024-09-16T14:41:36.390622+0000","last_clean":"2024-09-16T14:41:36.390622+0000","last_became_active":"2024-09-16T14:37:23.873310+0000","last_became_peered":"2024-09-16T14:37:23.873310+0000","last_unstale":"2024-09-16T14:41:36.390622+0000","last_undegraded":"2024-09-16T14:41:36.390622+0000","last_fullsized":"2024-09-16T14:41:36.390622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6413,"log_dups_size":0,"ondisk_log_size":6413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145360720,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":6379,"num_write_kb":204642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'6451","reported_seq":6466,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.374504+0000","last_change":"2024-09-16T14:37:24.066877+0000","last_active":"2024-09-16T14:41:36.374504+0000","last_peered":"2024-09-16T14:41:36.374504+0000","last_clean":"2024-09-16T14:41:36.374504+0000","last_became_active":"2024-09-16T14:37:24.066152+0000","last_became_peered":"2024-09-16T14:37:24.066152+0000","last_unstale":"2024-09-16T14:41:36.374504+0000","last_undegraded":"2024-09-16T14:41:36.374504+0000","last_fullsized":"2024-09-16T14:41:36.374504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6451,"log_dups_size":0,"ondisk_log_size":6451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:44:02.871099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6431,"num_write_kb":206020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"24'4098","reported_seq":4112,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.383909+0000","last_change":"2024-09-16T14:37:23.874229+0000","last_active":"2024-09-16T14:41:36.383909+0000","last_peered":"2024-09-16T14:41:36.383909+0000","last_clean":"2024-09-16T14:41:36.383909+0000","last_became_active":"2024-09-16T14:37:23.873770+0000","last_became_peered":"2024-09-16T14:37:23.873770+0000","last_unstale":"2024-09-16T14:41:36.383909+0000","last_undegraded":"2024-09-16T14:41:36.383909+0000","last_fullsized":"2024-09-16T14:41:36.383909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4098,"log_dups_size":0,"ondisk_log_size":4098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4049,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"23'6120","reported_seq":6139,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.377112+0000","last_change":"2024-09-16T14:37:23.872533+0000","last_active":"2024-09-16T14:41:36.377112+0000","last_peered":"2024-09-16T14:41:36.377112+0000","last_clean":"2024-09-16T14:41:36.377112+0000","last_became_active":"2024-09-16T14:37:23.872035+0000","last_became_peered":"2024-09-16T14:37:23.872035+0000","last_unstale":"2024-09-16T14:41:36.377112+0000","last_undegraded":"2024-09-16T14:41:36.377112+0000","last_fullsized":"2024-09-16T14:41:36.377112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6120,"log_dups_size":0,"ondisk_log_size":6120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97783808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6122,"num_write_kb":160588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"23'5236","reported_seq":5556,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.377493+0000","last_change":"2024-09-16T14:37:23.867566+0000","last_active":"2024-09-16T14:41:36.377493+0000","last_peered":"2024-09-16T14:41:36.377493+0000","last_clean":"2024-09-16T14:41:36.377493+0000","last_became_active":"2024-09-16T14:37:23.867197+0000","last_became_peered":"2024-09-16T14:37:23.867197+0000","last_unstale":"2024-09-16T14:41:36.377493+0000","last_undegraded":"2024-09-16T14:41:36.377493+0000","last_fullsized":"2024-09-16T14:41:36.377493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5236,"log_dups_size":0,"ondisk_log_size":5236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":1023,"num_read_kb":980,"num_write":5443,"num_write_kb":163369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"24'4374","reported_seq":4490,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.311766+0000","last_change":"2024-09-16T14:37:23.867465+0000","last_active":"2024-09-16T14:41:36.311766+0000","last_peered":"2024-09-16T14:41:36.311766+0000","last_clean":"2024-09-16T14:41:36.311766+0000","last_became_active":"2024-09-16T14:37:23.866604+0000","last_became_peered":"2024-09-16T14:37:23.866604+0000","last_unstale":"2024-09-16T14:41:36.311766+0000","last_undegraded":"2024-09-16T14:41:36.311766+0000","last_fullsized":"2024-09-16T14:41:36.311766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4374,"log_dups_size":0,"ondisk_log_size":4374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:53:37.384963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109183504,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":4368,"num_write_kb":166111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"23'6921","reported_seq":6939,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:26.163914+0000","last_change":"2024-09-16T14:37:23.871305+0000","last_active":"2024-09-16T14:41:26.163914+0000","last_peered":"2024-09-16T14:41:26.163914+0000","last_clean":"2024-09-16T14:41:26.163914+0000","last_became_active":"2024-09-16T14:37:23.871022+0000","last_became_peered":"2024-09-16T14:37:23.871022+0000","last_unstale":"2024-09-16T14:41:26.163914+0000","last_undegraded":"2024-09-16T14:41:26.163914+0000","last_fullsized":"2024-09-16T14:41:26.163914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6921,"log_dups_size":0,"ondisk_log_size":6921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:17:41.652894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111198208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6926,"num_write_kb":195181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'5445","reported_seq":5464,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.385345+0000","last_change":"2024-09-16T14:37:23.866707+0000","last_active":"2024-09-16T14:41:36.385345+0000","last_peered":"2024-09-16T14:41:36.385345+0000","last_clean":"2024-09-16T14:41:36.385345+0000","last_became_active":"2024-09-16T14:37:23.866386+0000","last_became_peered":"2024-09-16T14:37:23.866386+0000","last_unstale":"2024-09-16T14:41:36.385345+0000","last_undegraded":"2024-09-16T14:41:36.385345+0000","last_fullsized":"2024-09-16T14:41:36.385345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5445,"log_dups_size":0,"ondisk_log_size":5445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":5404,"num_write_kb":164450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:37.525650+0000","last_change":"2024-09-16T14:37:18.312221+0000","last_active":"2024-09-16T14:41:37.525650+0000","last_peered":"2024-09-16T14:41:37.525650+0000","last_clean":"2024-09-16T14:41:37.525650+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:41:37.525650+0000","last_undegraded":"2024-09-16T14:41:37.525650+0000","last_fullsized":"2024-09-16T14:41:37.525650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4801","reported_seq":4815,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.389450+0000","last_change":"2024-09-16T14:37:23.875261+0000","last_active":"2024-09-16T14:41:36.389450+0000","last_peered":"2024-09-16T14:41:36.389450+0000","last_clean":"2024-09-16T14:41:36.389450+0000","last_became_active":"2024-09-16T14:37:23.874796+0000","last_became_peered":"2024-09-16T14:37:23.874796+0000","last_unstale":"2024-09-16T14:41:36.389450+0000","last_undegraded":"2024-09-16T14:41:36.389450+0000","last_fullsized":"2024-09-16T14:41:36.389450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4801,"log_dups_size":0,"ondisk_log_size":4801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4775,"num_write_kb":162435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.192066+0000","last_change":"2024-09-16T14:41:42.192238+0000","last_active":"2024-09-16T14:41:42.192066+0000","last_peered":"2024-09-16T14:41:42.192066+0000","last_clean":"2024-09-16T14:41:42.192066+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:41:42.192066+0000","last_undegraded":"2024-09-16T14:41:42.192066+0000","last_fullsized":"2024-09-16T14:41:42.192066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:42.192014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:42.192014+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.192014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:51.135209+0000","scrub_duration":0.0035016019999999999,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'3460","reported_seq":3474,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.375468+0000","last_change":"2024-09-16T14:37:23.875452+0000","last_active":"2024-09-16T14:41:36.375468+0000","last_peered":"2024-09-16T14:41:36.375468+0000","last_clean":"2024-09-16T14:41:36.375468+0000","last_became_active":"2024-09-16T14:37:23.874901+0000","last_became_peered":"2024-09-16T14:37:23.874901+0000","last_unstale":"2024-09-16T14:41:36.375468+0000","last_undegraded":"2024-09-16T14:41:36.375468+0000","last_fullsized":"2024-09-16T14:41:36.375468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3460,"log_dups_size":0,"ondisk_log_size":3460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3408,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.324725+0000","last_change":"2024-09-16T14:37:18.311955+0000","last_active":"2024-09-16T14:41:36.324725+0000","last_peered":"2024-09-16T14:41:36.324725+0000","last_clean":"2024-09-16T14:41:36.324725+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:41:36.324725+0000","last_undegraded":"2024-09-16T14:41:36.324725+0000","last_fullsized":"2024-09-16T14:41:36.324725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"23'5596","reported_seq":5627,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:34.296119+0000","last_change":"2024-09-16T14:37:23.871434+0000","last_active":"2024-09-16T14:41:34.296119+0000","last_peered":"2024-09-16T14:41:34.296119+0000","last_clean":"2024-09-16T14:41:34.296119+0000","last_became_active":"2024-09-16T14:37:23.871068+0000","last_became_peered":"2024-09-16T14:37:23.871068+0000","last_unstale":"2024-09-16T14:41:34.296119+0000","last_undegraded":"2024-09-16T14:41:34.296119+0000","last_fullsized":"2024-09-16T14:41:34.296119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":5596,"log_dups_size":0,"ondisk_log_size":5596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:26:03.808662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":5614,"num_write_kb":199780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.376640+0000","last_change":"2024-09-16T14:37:18.445088+0000","last_active":"2024-09-16T14:41:36.376640+0000","last_peered":"2024-09-16T14:41:36.376640+0000","last_clean":"2024-09-16T14:41:36.376640+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:41:36.376640+0000","last_undegraded":"2024-09-16T14:41:36.376640+0000","last_fullsized":"2024-09-16T14:41:36.376640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"22'4153","reported_seq":4176,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:34.389117+0000","last_change":"2024-09-16T14:37:23.871756+0000","last_active":"2024-09-16T14:41:34.389117+0000","last_peered":"2024-09-16T14:41:34.389117+0000","last_clean":"2024-09-16T14:41:34.389117+0000","last_became_active":"2024-09-16T14:37:23.871465+0000","last_became_peered":"2024-09-16T14:37:23.871465+0000","last_unstale":"2024-09-16T14:41:34.389117+0000","last_undegraded":"2024-09-16T14:41:34.389117+0000","last_fullsized":"2024-09-16T14:41:34.389117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4153,"log_dups_size":0,"ondisk_log_size":4153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:48:14.130571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":4172,"num_write_kb":171144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"22'3334","reported_seq":3371,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:34.342654+0000","last_change":"2024-09-16T14:37:23.872581+0000","last_active":"2024-09-16T14:41:34.342654+0000","last_peered":"2024-09-16T14:41:34.342654+0000","last_clean":"2024-09-16T14:41:34.342654+0000","last_became_active":"2024-09-16T14:37:23.872385+0000","last_became_peered":"2024-09-16T14:37:23.872385+0000","last_unstale":"2024-09-16T14:41:34.342654+0000","last_undegraded":"2024-09-16T14:41:34.342654+0000","last_fullsized":"2024-09-16T14:41:34.342654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3334,"log_dups_size":0,"ondisk_log_size":3334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:05:22.498912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96731664,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":85,"num_read_kb":129,"num_write":3384,"num_write_kb":160971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.323423+0000","last_change":"2024-09-16T14:37:18.311825+0000","last_active":"2024-09-16T14:41:36.323423+0000","last_peered":"2024-09-16T14:41:36.323423+0000","last_clean":"2024-09-16T14:41:36.323423+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:41:36.323423+0000","last_undegraded":"2024-09-16T14:41:36.323423+0000","last_fullsized":"2024-09-16T14:41:36.323423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"24'3340","reported_seq":3363,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.392147+0000","last_change":"2024-09-16T14:37:23.875984+0000","last_active":"2024-09-16T14:41:36.392147+0000","last_peered":"2024-09-16T14:41:36.392147+0000","last_clean":"2024-09-16T14:41:36.392147+0000","last_became_active":"2024-09-16T14:37:23.874911+0000","last_became_peered":"2024-09-16T14:37:23.874911+0000","last_unstale":"2024-09-16T14:41:36.392147+0000","last_undegraded":"2024-09-16T14:41:36.392147+0000","last_fullsized":"2024-09-16T14:41:36.392147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3340,"log_dups_size":0,"ondisk_log_size":3340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3305,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:27.297946+0000","last_change":"2024-09-16T14:37:18.446072+0000","last_active":"2024-09-16T14:41:27.297946+0000","last_peered":"2024-09-16T14:41:27.297946+0000","last_clean":"2024-09-16T14:41:27.297946+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:41:27.297946+0000","last_undegraded":"2024-09-16T14:41:27.297946+0000","last_fullsized":"2024-09-16T14:41:27.297946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:00:52.557322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'4080","reported_seq":4094,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.312611+0000","last_change":"2024-09-16T14:37:23.876205+0000","last_active":"2024-09-16T14:41:36.312611+0000","last_peered":"2024-09-16T14:41:36.312611+0000","last_clean":"2024-09-16T14:41:36.312611+0000","last_became_active":"2024-09-16T14:37:23.875930+0000","last_became_peered":"2024-09-16T14:37:23.875930+0000","last_unstale":"2024-09-16T14:41:36.312611+0000","last_undegraded":"2024-09-16T14:41:36.312611+0000","last_fullsized":"2024-09-16T14:41:36.312611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4080,"log_dups_size":0,"ondisk_log_size":4080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:21:02.546999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":169350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.323193+0000","last_change":"2024-09-16T14:37:18.310876+0000","last_active":"2024-09-16T14:41:36.323193+0000","last_peered":"2024-09-16T14:41:36.323193+0000","last_clean":"2024-09-16T14:41:36.323193+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:41:36.323193+0000","last_undegraded":"2024-09-16T14:41:36.323193+0000","last_fullsized":"2024-09-16T14:41:36.323193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"23'4606","reported_seq":4625,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:37.351222+0000","last_change":"2024-09-16T14:37:23.873479+0000","last_active":"2024-09-16T14:41:37.351222+0000","last_peered":"2024-09-16T14:41:37.351222+0000","last_clean":"2024-09-16T14:41:37.351222+0000","last_became_active":"2024-09-16T14:37:23.873060+0000","last_became_peered":"2024-09-16T14:37:23.873060+0000","last_unstale":"2024-09-16T14:41:37.351222+0000","last_undegraded":"2024-09-16T14:41:37.351222+0000","last_fullsized":"2024-09-16T14:41:37.351222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96536232,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12,"num_read_kb":135,"num_write":4615,"num_write_kb":187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.323407+0000","last_change":"2024-09-16T14:37:18.312343+0000","last_active":"2024-09-16T14:41:36.323407+0000","last_peered":"2024-09-16T14:41:36.323407+0000","last_clean":"2024-09-16T14:41:36.323407+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:41:36.323407+0000","last_undegraded":"2024-09-16T14:41:36.323407+0000","last_fullsized":"2024-09-16T14:41:36.323407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:15.256961+0000","last_clean_scrub_stamp":"2024-09-16T14:37:15.256961+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:41:14.433039+0000","last_change":"2024-09-16T14:37:15.105418+0000","last_active":"2024-09-16T14:41:14.433039+0000","last_peered":"2024-09-16T14:41:14.433039+0000","last_clean":"2024-09-16T14:41:14.433039+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:41:14.433039+0000","last_undegraded":"2024-09-16T14:41:14.433039+0000","last_fullsized":"2024-09-16T14:41:14.433039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:13.233269+0000","last_clean_scrub_stamp":"2024-09-16T14:37:13.233269+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:34:11.758633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'3704","reported_seq":3724,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.391833+0000","last_change":"2024-09-16T14:37:23.875363+0000","last_active":"2024-09-16T14:41:36.391833+0000","last_peered":"2024-09-16T14:41:36.391833+0000","last_clean":"2024-09-16T14:41:36.391833+0000","last_became_active":"2024-09-16T14:37:23.874809+0000","last_became_peered":"2024-09-16T14:37:23.874809+0000","last_unstale":"2024-09-16T14:41:36.391833+0000","last_undegraded":"2024-09-16T14:41:36.391833+0000","last_fullsized":"2024-09-16T14:41:36.391833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3704,"log_dups_size":0,"ondisk_log_size":3704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88155160,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":3655,"num_write_kb":140764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"24'8771","reported_seq":8908,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.427642+0000","last_change":"2024-09-16T14:37:23.871280+0000","last_active":"2024-09-16T14:41:36.427642+0000","last_peered":"2024-09-16T14:41:36.427642+0000","last_clean":"2024-09-16T14:41:36.427642+0000","last_became_active":"2024-09-16T14:37:23.870990+0000","last_became_peered":"2024-09-16T14:37:23.870990+0000","last_unstale":"2024-09-16T14:41:36.427642+0000","last_undegraded":"2024-09-16T14:41:36.427642+0000","last_fullsized":"2024-09-16T14:41:36.427642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":8771,"log_dups_size":0,"ondisk_log_size":8771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":416,"num_read_kb":374,"num_write":6755,"num_write_kb":203154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'4584","reported_seq":4598,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.385498+0000","last_change":"2024-09-16T14:37:23.864603+0000","last_active":"2024-09-16T14:41:36.385498+0000","last_peered":"2024-09-16T14:41:36.385498+0000","last_clean":"2024-09-16T14:41:36.385498+0000","last_became_active":"2024-09-16T14:37:23.864034+0000","last_became_peered":"2024-09-16T14:37:23.864034+0000","last_unstale":"2024-09-16T14:41:36.385498+0000","last_undegraded":"2024-09-16T14:41:36.385498+0000","last_fullsized":"2024-09-16T14:41:36.385498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4557,"num_write_kb":210052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"22'3924","reported_seq":3937,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-16T14:40:21.008320+0000","last_change":"2024-09-16T14:37:23.874896+0000","last_active":"2024-09-16T14:40:21.008320+0000","last_peered":"2024-09-16T14:40:21.008320+0000","last_clean":"2024-09-16T14:40:21.008320+0000","last_became_active":"2024-09-16T14:37:23.874573+0000","last_became_peered":"2024-09-16T14:37:23.874573+0000","last_unstale":"2024-09-16T14:40:21.008320+0000","last_undegraded":"2024-09-16T14:40:21.008320+0000","last_fullsized":"2024-09-16T14:40:21.008320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3924,"log_dups_size":0,"ondisk_log_size":3924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:27.278143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":193410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"24'2812","reported_seq":2825,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.383404+0000","last_change":"2024-09-16T14:37:23.874358+0000","last_active":"2024-09-16T14:41:36.383404+0000","last_peered":"2024-09-16T14:41:36.383404+0000","last_clean":"2024-09-16T14:41:36.383404+0000","last_became_active":"2024-09-16T14:37:23.874099+0000","last_became_peered":"2024-09-16T14:37:23.874099+0000","last_unstale":"2024-09-16T14:41:36.383404+0000","last_undegraded":"2024-09-16T14:41:36.383404+0000","last_fullsized":"2024-09-16T14:41:36.383404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2812,"log_dups_size":0,"ondisk_log_size":2812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:41:21.931138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78251856,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":122330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"24'3968","reported_seq":3993,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.381997+0000","last_change":"2024-09-16T14:37:23.865919+0000","last_active":"2024-09-16T14:41:36.381997+0000","last_peered":"2024-09-16T14:41:36.381997+0000","last_clean":"2024-09-16T14:41:36.381997+0000","last_became_active":"2024-09-16T14:37:23.865656+0000","last_became_peered":"2024-09-16T14:37:23.865656+0000","last_unstale":"2024-09-16T14:41:36.381997+0000","last_undegraded":"2024-09-16T14:41:36.381997+0000","last_fullsized":"2024-09-16T14:41:36.381997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3968,"log_dups_size":0,"ondisk_log_size":3968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":36,"num_write":3967,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'4557","reported_seq":4680,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.398117+0000","last_change":"2024-09-16T14:37:23.869225+0000","last_active":"2024-09-16T14:41:36.398117+0000","last_peered":"2024-09-16T14:41:36.398117+0000","last_clean":"2024-09-16T14:41:36.398117+0000","last_became_active":"2024-09-16T14:37:23.868935+0000","last_became_peered":"2024-09-16T14:37:23.868935+0000","last_unstale":"2024-09-16T14:41:36.398117+0000","last_undegraded":"2024-09-16T14:41:36.398117+0000","last_fullsized":"2024-09-16T14:41:36.398117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4557,"log_dups_size":0,"ondisk_log_size":4557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:40:51.366518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100073992,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":376,"num_read_kb":299,"num_write":4840,"num_write_kb":173375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'2698","reported_seq":2713,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.382528+0000","last_change":"2024-09-16T14:37:23.868668+0000","last_active":"2024-09-16T14:41:36.382528+0000","last_peered":"2024-09-16T14:41:36.382528+0000","last_clean":"2024-09-16T14:41:36.382528+0000","last_became_active":"2024-09-16T14:37:23.868262+0000","last_became_peered":"2024-09-16T14:37:23.868262+0000","last_unstale":"2024-09-16T14:41:36.382528+0000","last_undegraded":"2024-09-16T14:41:36.382528+0000","last_fullsized":"2024-09-16T14:41:36.382528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2698,"log_dups_size":0,"ondisk_log_size":2698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:08:42.842709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79823376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2657,"num_write_kb":119691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'3789","reported_seq":3808,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.384890+0000","last_change":"2024-09-16T14:37:24.066472+0000","last_active":"2024-09-16T14:41:36.384890+0000","last_peered":"2024-09-16T14:41:36.384890+0000","last_clean":"2024-09-16T14:41:36.384890+0000","last_became_active":"2024-09-16T14:37:24.065966+0000","last_became_peered":"2024-09-16T14:37:24.065966+0000","last_unstale":"2024-09-16T14:41:36.384890+0000","last_undegraded":"2024-09-16T14:41:36.384890+0000","last_fullsized":"2024-09-16T14:41:36.384890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":3789,"log_dups_size":0,"ondisk_log_size":3789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:16:40.228633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":3750,"num_write_kb":213570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"22'2640","reported_seq":2654,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.323308+0000","last_change":"2024-09-16T14:37:23.866814+0000","last_active":"2024-09-16T14:41:36.323308+0000","last_peered":"2024-09-16T14:41:36.323308+0000","last_clean":"2024-09-16T14:41:36.323308+0000","last_became_active":"2024-09-16T14:37:23.866545+0000","last_became_peered":"2024-09-16T14:37:23.866545+0000","last_unstale":"2024-09-16T14:41:36.323308+0000","last_undegraded":"2024-09-16T14:41:36.323308+0000","last_fullsized":"2024-09-16T14:41:36.323308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":119555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"24'2405","reported_seq":2418,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.388964+0000","last_change":"2024-09-16T14:37:23.873436+0000","last_active":"2024-09-16T14:41:36.388964+0000","last_peered":"2024-09-16T14:41:36.388964+0000","last_clean":"2024-09-16T14:41:36.388964+0000","last_became_active":"2024-09-16T14:37:23.873069+0000","last_became_peered":"2024-09-16T14:37:23.873069+0000","last_unstale":"2024-09-16T14:41:36.388964+0000","last_undegraded":"2024-09-16T14:41:36.388964+0000","last_fullsized":"2024-09-16T14:41:36.388964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2405,"log_dups_size":0,"ondisk_log_size":2405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:22:12.516441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88145920,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2351,"num_write_kb":101825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"24'7758","reported_seq":7774,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.385345+0000","last_change":"2024-09-16T14:37:23.868786+0000","last_active":"2024-09-16T14:41:36.385345+0000","last_peered":"2024-09-16T14:41:36.385345+0000","last_clean":"2024-09-16T14:41:36.385345+0000","last_became_active":"2024-09-16T14:37:23.868469+0000","last_became_peered":"2024-09-16T14:37:23.868469+0000","last_unstale":"2024-09-16T14:41:36.385345+0000","last_undegraded":"2024-09-16T14:41:36.385345+0000","last_fullsized":"2024-09-16T14:41:36.385345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":7758,"log_dups_size":0,"ondisk_log_size":7758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":7743,"num_write_kb":271203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3548455160,"num_objects":873,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":873,"num_whiteouts":0,"num_read":2563,"num_read_kb":2579,"num_write":150750,"num_write_kb":5600677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6780297216,"data_stored":6795560056,"data_compressed":70367536,"data_compressed_allocated":73326592,"data_compressed_original":92856320,"omap_allocated":0,"internal_metadata":0},"log_size":152567,"ondisk_log_size":152567,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1039868,"kb_used_data":778288,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":93331972,"statfs":{"total":96636764160,"available":95571939328,"internally_reserved":0,"allocated":796966912,"data_stored":799458522,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.68100000000000005},"min":{"1min":0.40200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.3660000000000001,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94899999999999995,"15min":1.0940000000000001},"min":{"1min":0.503,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1519999999999999,"5min":10.654999999999999,"15min":10.654999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70799999999999996,"15min":0.65300000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.522,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.73899999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.745,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.997},{"interface":"front","average":{"1min":0.878,"5min":0.86899999999999999,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0960000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.139}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.365,"15min":1.3280000000000001},"min":{"1min":0.45400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.571,"5min":28.141999999999999,"15min":28.141999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.0800000000000001,"15min":0.81799999999999995},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.069,"5min":28.109999999999999,"15min":28.109999999999999},"last":0.83799999999999997}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90000000000000002,"15min":0.91800000000000004},"min":{"1min":0.41599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.208,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.876},"min":{"1min":0.434,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.256,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.0269999999999999}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.202,"15min":1.46},"min":{"1min":0.66700000000000004,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1719999999999999,"5min":14.289,"15min":14.289},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.92100000000000004},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.4710000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.89200000000000002}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96799999999999997,"15min":0.91300000000000003},"min":{"1min":0.57299999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6279999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.95199999999999996,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2949999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.171}]}]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1148012,"kb_used_data":850336,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93223828,"statfs":{"total":96636764160,"available":95461199872,"internally_reserved":0,"allocated":870744064,"data_stored":872705543,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.496},"min":{"1min":0.251,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.84199999999999997,"5min":1.857,"15min":1.857},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.5}]},{"osd":1,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.84399999999999997,"15min":1.0529999999999999},"min":{"1min":0.255,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.92700000000000005,"5min":12.141,"15min":12.141},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.318,"5min":0.224,"15min":0.224},"max":{"1min":1.1830000000000001,"5min":1.657,"15min":1.657},"last":0.61499999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.224,"15min":0.224},"max":{"1min":0.86199999999999999,"5min":1.077,"15min":1.077},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.147,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0600000000000001,"15min":0.997},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3009999999999999,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":0.92600000000000005}]},{"osd":5,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.343,"5min":1.786,"15min":1.786},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.95799999999999996,"15min":0.86399999999999999},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.1849999999999996,"5min":5.7869999999999999,"15min":5.7869999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4370000000000001,"5min":1.968,"15min":1.968},"last":1.073},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":0.94599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.389,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0229999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.323,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.89700000000000002},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3089999999999999,"5min":1.7,"15min":1.7},"last":0.995}]}]},{"osd":1,"up_from":14,"seq":60129542203,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191472,"kb_used_data":935652,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93180368,"statfs":{"total":96636764160,"available":95416696832,"internally_reserved":0,"allocated":958107648,"data_stored":959426311,"data_compressed":13128965,"data_compressed_allocated":13701120,"data_compressed_original":15773696,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.70299999999999996,"15min":0.79800000000000004},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":1.181,"5min":3.02,"15min":3.02},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71799999999999997,"15min":0.80200000000000005},"min":{"1min":0.26400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":1.0920000000000001,"5min":3.141,"15min":3.141},"last":0.89500000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.82199999999999995,"15min":1.0369999999999999},"min":{"1min":0.217,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.96899999999999997,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.755},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.873,"15min":1.0580000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.202,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.83299999999999996}]},{"osd":3,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.427,"15min":1.383},"min":{"1min":0.32400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.82299999999999995,"5min":48.195,"15min":48.195},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.748,"5min":1.4379999999999999,"15min":2.069},"min":{"1min":0.31,"5min":0.246,"15min":0.246},"max":{"1min":1.2609999999999999,"5min":25.248000000000001,"15min":25.248000000000001},"last":0.91600000000000004}]},{"osd":4,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3759999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91400000000000003,"15min":0.88600000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.544,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.173}]},{"osd":5,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.024,"15min":1.1120000000000001},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.206,"5min":5.819,"15min":5.819},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88,"15min":0.83199999999999996},"min":{"1min":0.59499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.371,"5min":1.611,"15min":1.611},"last":1.2110000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.94699999999999995},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6479999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":1.258},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.59399999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3620000000000001,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":1.284}]},{"osd":7,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.466,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":0.875},"min":{"1min":0.51300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3240000000000001,"5min":1.544,"15min":1.544},"last":1.3160000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255288,"kb_used_data":921516,"kb_used_omap":1,"kb_used_meta":333758,"kb_avail":93116552,"statfs":{"total":96636764160,"available":95351349248,"internally_reserved":0,"allocated":943632384,"data_stored":944635399,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":1594,"internal_metadata":341768646},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.746},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.73299999999999998},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.88700000000000001,"5min":4.9779999999999998,"15min":4.9779999999999998},"last":0.88200000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91300000000000003,"5min":5.0839999999999996,"15min":5.0839999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.96699999999999997,"15min":1.149},"min":{"1min":0.307,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0449999999999999,"5min":7.6040000000000001,"15min":7.6040000000000001},"last":0.65500000000000003}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.262,"15min":1.8340000000000001},"min":{"1min":0.28100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":17.472000000000001,"15min":17.472000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.78200000000000003},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.254},"max":{"1min":1.073,"5min":3.9649999999999999,"15min":3.9649999999999999},"last":1.0489999999999999}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.82799999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.224,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.53},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.335}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.1739999999999999,"15min":1.423},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4239999999999999,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.02,"5min":0.998,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":5.9429999999999996,"15min":5.9429999999999996},"last":1.411}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95199999999999996,"15min":0.92000000000000004},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3300000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.173,"15min":1.363},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.4970000000000001,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":1.47}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0880000000000001,"15min":1.1759999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.528,"5min":7.5819999999999999,"15min":7.5819999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.079},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4870000000000001,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":1.198}]}]},{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":531232,"kb_used_data":432020,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93840608,"statfs":{"total":96636764160,"available":96092782592,"internally_reserved":0,"allocated":442388480,"data_stored":444222051,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":1589,"internal_metadata":101579211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.1639999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.85399999999999998,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1180000000000001,"5min":8.6959999999999997,"15min":8.6959999999999997},"last":0.85699999999999998}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76000000000000001,"15min":0.67700000000000005},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.907,"15min":1.907},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78600000000000003,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.999,"5min":5.798,"15min":5.798},"last":1.0129999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.78600000000000003},"min":{"1min":0.56200000000000006,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.169,"5min":4.109,"15min":4.109},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.327,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.1499999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.498,"15min":1.98},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":24.472000000000001,"15min":24.472000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0740000000000001,"15min":1.258},"min":{"1min":0.55300000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1240000000000001,"5min":6.6139999999999999,"15min":6.6139999999999999},"last":0.88}]},{"osd":4,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82699999999999996,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.29,"5min":1.377,"15min":1.377},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.77000000000000002},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.413,"5min":1.581,"15min":1.581},"last":0.78800000000000003}]},{"osd":5,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.83399999999999996},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.339,"5min":1.712,"15min":1.712},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.93000000000000005,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2010000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.23}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.008,"15min":0.93999999999999995},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.248,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.1180000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1226124,"kb_used_data":880068,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93145716,"statfs":{"total":96636764160,"available":95381213184,"internally_reserved":0,"allocated":901189632,"data_stored":902465855,"data_compressed":6836315,"data_compressed_allocated":7131136,"data_compressed_original":9027584,"omap_allocated":1594,"internal_metadata":354351558},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76500000000000001,"15min":0.69499999999999995},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.161,"5min":6.4800000000000004,"15min":6.4800000000000004},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.82299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3620000000000001,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.99299999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.96399999999999997,"15min":1.034},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.046,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":1.0329999999999999},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":0.70599999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82899999999999996,"15min":0.78100000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1910000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":1.034}]},{"osd":3,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84599999999999997},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.244,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.089},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2250000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.1200000000000001}]},{"osd":4,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.145,"5min":1.319,"15min":1.319},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":4.2720000000000002,"15min":7.6070000000000002},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.399,"5min":91.039000000000001,"15min":91.039000000000001},"last":1.236}]},{"osd":6,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.296},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99199999999999999,"15min":0.94899999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.194}]},{"osd":7,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.006,"15min":0.94299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.337,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.391},{"interface":"front","average":{"1min":1.133,"5min":1.1000000000000001,"15min":1.024},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.593,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.1910000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":985596,"kb_used_data":729776,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93386244,"statfs":{"total":96636764160,"available":95627513856,"internally_reserved":0,"allocated":747290624,"data_stored":750299371,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.82599999999999996,"15min":0.93799999999999994},"min":{"1min":0.38600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.097,"5min":4.617,"15min":4.617},"last":1.028},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66900000000000004,"15min":0.623},"min":{"1min":0.32800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.65500000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.94499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3520000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":1},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.95099999999999996,"15min":1.117},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.212,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":0.88600000000000001}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.40899999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":2.528,"15min":2.528},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.4530000000000001,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.96799999999999997}]},{"osd":3,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.879,"15min":0.871},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.45000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.278,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1559999999999999,"5min":2.726,"15min":2.726},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.55500000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.131}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.633,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4330000000000001,"5min":1.782,"15min":1.782},"last":0.92000000000000004}]},{"osd":7,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.49099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.131,"5min":4.556,"15min":4.556},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0169999999999999,"15min":0.93600000000000005},"min":{"1min":0.5,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.206}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483560,"kb_used_data":1095644,"kb_used_omap":1,"kb_used_meta":387902,"kb_avail":92888280,"statfs":{"total":96636764160,"available":95117598720,"internally_reserved":0,"allocated":1121939456,"data_stored":1124037310,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":1592,"internal_metadata":397212104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.621},"min":{"1min":0.27900000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.84099999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":1.0269999999999999},"min":{"1min":0.34499999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.004,"5min":12.147,"15min":12.147},"last":0.66100000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.28,"5min":1.718,"15min":1.718},"last":0.622},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":0.63400000000000001},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77900000000000003,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.40600000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.85299999999999998},"min":{"1min":0.39300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.95299999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.505},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0920000000000001,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.34599999999999997}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.5389999999999999,"15min":2.1070000000000002},"min":{"1min":0.433,"5min":0.309,"15min":0.309},"max":{"1min":1.482,"5min":29.449000000000002,"15min":29.449000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.161,"5min":8.4499999999999993,"15min":8.4499999999999993},"last":0.751}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.1479999999999999,"15min":1.042},"min":{"1min":0.432,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":11.983000000000001,"5min":11.983000000000001,"15min":11.983000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.242,"15min":1.5740000000000001},"min":{"1min":0.5,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.22,"5min":13.377000000000001,"15min":13.377000000000001},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.161,"15min":1.337},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":13.334,"15min":13.334},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.569,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1499999999999999,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.7050000000000001,"5min":8.6829999999999998,"15min":8.6829999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2010000000000001,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.0070000000000001,"5min":8.7050000000000001,"15min":8.7050000000000001},"last":0.98499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":943403008,"data_stored":944556228,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":957816832,"data_stored":958818212,"data_compressed":13098947,"data_compressed_allocated":13660160,"data_compressed_original":15261696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":870514688,"data_stored":872626372,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1121705984,"data_stored":1123958120,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":747061248,"data_stored":750220200,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":900898816,"data_stored":901857756,"data_compressed":6806297,"data_compressed_allocated":7090176,"data_compressed_original":8515584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":796737536,"data_stored":799380288,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":442159104,"data_stored":444142880,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:41:43.469 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.469 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.470 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.471 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.472 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-16T14:37:15.256961+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=15, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T14:37:13.233269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=13, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.473 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.474 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.474 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.474 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.474 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.474 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:41:43.474 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:42:03.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:42:03.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc45001700 1 Processor -- start 2024-09-16T14:42:03.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc45001700 1 -- start start 2024-09-16T14:42:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc45001700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4013f6f0 con 0x7efc4013ef90 2024-09-16T14:42:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc45001700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40071120 con 0x7efc40070d40 2024-09-16T14:42:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc45001700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4006d630 con 0x7efc400a8910 2024-09-16T14:42:03.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc44800700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efc4013ef90 0x7efc4013e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45944/0 (socket says 172.21.15.73:45944) 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc44800700 1 -- 172.21.15.73:0/2803430678 learned_addr learned my addr 172.21.15.73:0/2803430678 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3f7fe700 1 --1- 172.21.15.73:0/2803430678 >> v1:172.21.15.73:6790/0 conn(0x7efc400a8910 0x7efc4006cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:44956/0 (socket says 172.21.15.73:44956) 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076518147 0 0) 0x7efc4013f6f0 con 0x7efc4013ef90 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc200035d0 con 0x7efc4013ef90 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797333752 0 0) 0x7efc40071120 con 0x7efc40070d40 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc4013f6f0 con 0x7efc40070d40 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469534267 0 0) 0x7efc4006d630 con 0x7efc400a8910 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc40071120 con 0x7efc400a8910 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260548589 0 0) 0x7efc200035d0 con 0x7efc4013ef90 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 >> v1:172.21.15.73:6790/0 conn(0x7efc400a8910 legacy=0x7efc4006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 >> v1:172.21.15.177:6789/0 conn(0x7efc40070d40 legacy=0x7efc4013fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400a8e50 con 0x7efc4013ef90 2024-09-16T14:42:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.595+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7efc38001610 con 0x7efc4013ef90 2024-09-16T14:42:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efc380018f0 con 0x7efc4013ef90 2024-09-16T14:42:03.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc3effd700 1 -- 172.21.15.73:0/2803430678 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7efc38001c80 con 0x7efc4013ef90 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- 172.21.15.73:0/2803430678 >> v1:172.21.15.73:6789/0 conn(0x7efc4013ef90 legacy=0x7efc4013e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- 172.21.15.73:0/2803430678 shutdown_connections 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- 172.21.15.73:0/2803430678 >> 172.21.15.73:0/2803430678 conn(0x7efc4006a360 msgr2=0x7efc4006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- 172.21.15.73:0/2803430678 shutdown_connections 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- 172.21.15.73:0/2803430678 wait complete. 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 Processor -- start 2024-09-16T14:42:03.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- start start 2024-09-16T14:42:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc401da500 con 0x7efc4013ef90 2024-09-16T14:42:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40138ae0 con 0x7efc400a8910 2024-09-16T14:42:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc45001700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc401380d0 con 0x7efc40070d40 2024-09-16T14:42:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc3ffff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7efc40070d40 0x7efc401d96e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:44972/0 (socket says 172.21.15.73:44972) 2024-09-16T14:42:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc3ffff700 1 -- 172.21.15.73:0/933757003 learned_addr learned my addr 172.21.15.73:0/933757003 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:42:03.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.599+0000 7efc44800700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efc4013ef90 0x7efc401e0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45960/0 (socket says 172.21.15.73:45960) 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798083061 0 0) 0x7efc401380d0 con 0x7efc40070d40 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc240035d0 con 0x7efc40070d40 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476278097 0 0) 0x7efc401da500 con 0x7efc4013ef90 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc401380d0 con 0x7efc4013ef90 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 830053432 0 0) 0x7efc240035d0 con 0x7efc40070d40 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efc401da500 con 0x7efc40070d40 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224821694 0 0) 0x7efc40138ae0 con 0x7efc400a8910 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc240035d0 con 0x7efc400a8910 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7efc30001c30 con 0x7efc40070d40 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3608299288 0 0) 0x7efc401380d0 con 0x7efc4013ef90 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efc40138ae0 con 0x7efc4013ef90 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7efc380015d0 con 0x7efc4013ef90 2024-09-16T14:42:03.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3449615568 0 0) 0x7efc401da500 con 0x7efc40070d40 2024-09-16T14:42:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 >> v1:172.21.15.177:6789/0 conn(0x7efc400a8910 legacy=0x7efc401d9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 >> v1:172.21.15.73:6789/0 conn(0x7efc4013ef90 legacy=0x7efc401e0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400705e0 con 0x7efc40070d40 2024-09-16T14:42:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc40070830 con 0x7efc40070d40 2024-09-16T14:42:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40070390 con 0x7efc40070d40 2024-09-16T14:42:03.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efc30002040 con 0x7efc40070d40 2024-09-16T14:42:03.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7efc30003cf0 con 0x7efc40070d40 2024-09-16T14:42:03.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc18005100 con 0x7efc40070d40 2024-09-16T14:42:03.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.603+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7efc30003ed0 con 0x7efc40070d40 2024-09-16T14:42:03.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.607+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7efc3007f8f0 con 0x7efc40070d40 2024-09-16T14:42:03.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.611+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7efc3004cf60 con 0x7efc40070d40 2024-09-16T14:42:03.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.779+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc18000b90 con 0x7efc2406fc20 2024-09-16T14:42:03.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.791+0000 7efc3cff9700 1 -- 172.21.15.73:0/933757003 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+154477 (unknown 2965378022 0 1776605998) 0x7efc18000b90 con 0x7efc2406fc20 2024-09-16T14:42:03.798 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:42:03.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.795+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 >> v1:172.21.15.177:6816/2823028339 conn(0x7efc2406fc20 legacy=0x7efc240720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.795+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 >> v1:172.21.15.73:6790/0 conn(0x7efc40070d40 legacy=0x7efc401d96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:03.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.795+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 shutdown_connections 2024-09-16T14:42:03.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.795+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 >> 172.21.15.73:0/933757003 conn(0x7efc4006a360 msgr2=0x7efc4006dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:42:03.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.795+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 shutdown_connections 2024-09-16T14:42:03.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:03.795+0000 7efc45001700 1 -- 172.21.15.73:0/933757003 wait complete. 2024-09-16T14:42:03.801 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:42:03.813 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-16T14:42:03.235841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3549045547,"num_objects":877,"num_object_clones":0,"num_object_copies":1754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":2679,"num_read_kb":2679,"num_write":150911,"num_write_kb":5603095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153473,"ondisk_log_size":153473,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8869316,"kb_used_data":6623300,"kb_used_omap":12,"kb_used_meta":2245939,"kb_avail":746105404,"statfs":{"total":773094113280,"available":764011933696,"internally_reserved":0,"allocated":6782259200,"data_stored":6797250362,"data_compressed":70427572,"data_compressed_allocated":73408512,"data_compressed_original":93880320,"omap_allocated":12744,"internal_metadata":2299842104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004020"},"pg_stats":[{"pgid":"3.1f","version":"24'4476","reported_seq":4541,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:54.100976+0000","last_change":"2024-09-16T14:41:54.101088+0000","last_active":"2024-09-16T14:41:54.100976+0000","last_peered":"2024-09-16T14:41:54.100976+0000","last_clean":"2024-09-16T14:41:54.100976+0000","last_became_active":"2024-09-16T14:37:24.063684+0000","last_became_peered":"2024-09-16T14:37:24.063684+0000","last_unstale":"2024-09-16T14:41:54.100976+0000","last_undegraded":"2024-09-16T14:41:54.100976+0000","last_fullsized":"2024-09-16T14:41:54.100976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4476","last_scrub_stamp":"2024-09-16T14:41:54.100952+0000","last_deep_scrub":"24'4476","last_deep_scrub_stamp":"2024-09-16T14:41:54.100952+0000","last_clean_scrub_stamp":"2024-09-16T14:41:54.100952+0000","objects_scrubbed":36,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:09:16.379199+0000","scrub_duration":0.37723048999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137234784,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":140,"num_read_kb":116,"num_write":4501,"num_write_kb":200999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'6715","reported_seq":6750,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:45.114044+0000","last_change":"2024-09-16T14:41:45.114145+0000","last_active":"2024-09-16T14:41:45.114044+0000","last_peered":"2024-09-16T14:41:45.114044+0000","last_clean":"2024-09-16T14:41:45.114044+0000","last_became_active":"2024-09-16T14:37:23.861295+0000","last_became_peered":"2024-09-16T14:37:23.861295+0000","last_unstale":"2024-09-16T14:41:45.114044+0000","last_undegraded":"2024-09-16T14:41:45.114044+0000","last_fullsized":"2024-09-16T14:41:45.114044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6715","last_scrub_stamp":"2024-09-16T14:41:45.114021+0000","last_deep_scrub":"24'6715","last_deep_scrub_stamp":"2024-09-16T14:41:45.114021+0000","last_clean_scrub_stamp":"2024-09-16T14:41:45.114021+0000","objects_scrubbed":28,"log_size":6715,"log_dups_size":0,"ondisk_log_size":6715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:42.607750+0000","scrub_duration":0.37396536000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6680,"num_write_kb":211796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'6872","reported_seq":6900,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.388012+0000","last_change":"2024-09-16T14:37:23.875435+0000","last_active":"2024-09-16T14:41:36.388012+0000","last_peered":"2024-09-16T14:41:36.388012+0000","last_clean":"2024-09-16T14:41:36.388012+0000","last_became_active":"2024-09-16T14:37:23.875180+0000","last_became_peered":"2024-09-16T14:37:23.875180+0000","last_unstale":"2024-09-16T14:41:36.388012+0000","last_undegraded":"2024-09-16T14:41:36.388012+0000","last_fullsized":"2024-09-16T14:41:36.388012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":6872,"log_dups_size":0,"ondisk_log_size":6872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":56,"num_read_kb":105,"num_write":6978,"num_write_kb":205252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"24'4559","reported_seq":4592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.953390+0000","last_change":"2024-09-16T14:41:50.953552+0000","last_active":"2024-09-16T14:41:50.953390+0000","last_peered":"2024-09-16T14:41:50.953390+0000","last_clean":"2024-09-16T14:41:50.953390+0000","last_became_active":"2024-09-16T14:37:23.875445+0000","last_became_peered":"2024-09-16T14:37:23.875445+0000","last_unstale":"2024-09-16T14:41:50.953390+0000","last_undegraded":"2024-09-16T14:41:50.953390+0000","last_fullsized":"2024-09-16T14:41:50.953390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4559","last_scrub_stamp":"2024-09-16T14:41:50.953352+0000","last_deep_scrub":"24'4559","last_deep_scrub_stamp":"2024-09-16T14:41:50.953352+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.953352+0000","objects_scrubbed":29,"log_size":4559,"log_dups_size":0,"ondisk_log_size":4559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:58:49.077424+0000","scrub_duration":0.36104712700000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113247232,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4552,"num_write_kb":157847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'6448","reported_seq":6483,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:49.471994+0000","last_change":"2024-09-16T14:41:49.472117+0000","last_active":"2024-09-16T14:41:49.471994+0000","last_peered":"2024-09-16T14:41:49.471994+0000","last_clean":"2024-09-16T14:41:49.471994+0000","last_became_active":"2024-09-16T14:37:23.873310+0000","last_became_peered":"2024-09-16T14:37:23.873310+0000","last_unstale":"2024-09-16T14:41:49.471994+0000","last_undegraded":"2024-09-16T14:41:49.471994+0000","last_fullsized":"2024-09-16T14:41:49.471994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6448","last_scrub_stamp":"2024-09-16T14:41:49.471972+0000","last_deep_scrub":"24'6448","last_deep_scrub_stamp":"2024-09-16T14:41:49.471972+0000","last_clean_scrub_stamp":"2024-09-16T14:41:49.471972+0000","objects_scrubbed":35,"log_size":6448,"log_dups_size":0,"ondisk_log_size":6448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:24.023723+0000","scrub_duration":0.462550293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145360720,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":6379,"num_write_kb":204642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'6483","reported_seq":6512,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:41.941935+0000","last_change":"2024-09-16T14:41:41.942098+0000","last_active":"2024-09-16T14:41:41.941935+0000","last_peered":"2024-09-16T14:41:41.941935+0000","last_clean":"2024-09-16T14:41:41.941935+0000","last_became_active":"2024-09-16T14:37:24.066152+0000","last_became_peered":"2024-09-16T14:37:24.066152+0000","last_unstale":"2024-09-16T14:41:41.941935+0000","last_undegraded":"2024-09-16T14:41:41.941935+0000","last_fullsized":"2024-09-16T14:41:41.941935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6483","last_scrub_stamp":"2024-09-16T14:41:41.941891+0000","last_deep_scrub":"24'6483","last_deep_scrub_stamp":"2024-09-16T14:41:41.941891+0000","last_clean_scrub_stamp":"2024-09-16T14:41:41.941891+0000","objects_scrubbed":32,"log_size":6483,"log_dups_size":0,"ondisk_log_size":6483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:51:22.646685+0000","scrub_duration":0.40636304499999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6431,"num_write_kb":206020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"24'4127","reported_seq":4154,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:48.320476+0000","last_change":"2024-09-16T14:41:48.320582+0000","last_active":"2024-09-16T14:41:48.320476+0000","last_peered":"2024-09-16T14:41:48.320476+0000","last_clean":"2024-09-16T14:41:48.320476+0000","last_became_active":"2024-09-16T14:37:23.873770+0000","last_became_peered":"2024-09-16T14:37:23.873770+0000","last_unstale":"2024-09-16T14:41:48.320476+0000","last_undegraded":"2024-09-16T14:41:48.320476+0000","last_fullsized":"2024-09-16T14:41:48.320476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4127","last_scrub_stamp":"2024-09-16T14:41:48.320455+0000","last_deep_scrub":"24'4127","last_deep_scrub_stamp":"2024-09-16T14:41:48.320455+0000","last_clean_scrub_stamp":"2024-09-16T14:41:48.320455+0000","objects_scrubbed":29,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:50.588145+0000","scrub_duration":0.32698546099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4049,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"24'6144","reported_seq":6176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.098906+0000","last_change":"2024-09-16T14:41:50.099031+0000","last_active":"2024-09-16T14:41:50.098906+0000","last_peered":"2024-09-16T14:41:50.098906+0000","last_clean":"2024-09-16T14:41:50.098906+0000","last_became_active":"2024-09-16T14:37:23.872035+0000","last_became_peered":"2024-09-16T14:37:23.872035+0000","last_unstale":"2024-09-16T14:41:50.098906+0000","last_undegraded":"2024-09-16T14:41:50.098906+0000","last_fullsized":"2024-09-16T14:41:50.098906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6144","last_scrub_stamp":"2024-09-16T14:41:50.098873+0000","last_deep_scrub":"24'6144","last_deep_scrub_stamp":"2024-09-16T14:41:50.098873+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.098873+0000","objects_scrubbed":25,"log_size":6144,"log_dups_size":0,"ondisk_log_size":6144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:40:57.369476+0000","scrub_duration":0.35252025300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97783808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6122,"num_write_kb":160588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'5263","reported_seq":5596,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:49.113488+0000","last_change":"2024-09-16T14:41:49.113595+0000","last_active":"2024-09-16T14:41:49.113488+0000","last_peered":"2024-09-16T14:41:49.113488+0000","last_clean":"2024-09-16T14:41:49.113488+0000","last_became_active":"2024-09-16T14:37:23.867197+0000","last_became_peered":"2024-09-16T14:37:23.867197+0000","last_unstale":"2024-09-16T14:41:49.113488+0000","last_undegraded":"2024-09-16T14:41:49.113488+0000","last_fullsized":"2024-09-16T14:41:49.113488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5263","last_scrub_stamp":"2024-09-16T14:41:49.113464+0000","last_deep_scrub":"24'5263","last_deep_scrub_stamp":"2024-09-16T14:41:49.113464+0000","last_clean_scrub_stamp":"2024-09-16T14:41:49.113464+0000","objects_scrubbed":27,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:01:54.308281+0000","scrub_duration":0.34071211000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":1023,"num_read_kb":980,"num_write":5443,"num_write_kb":163369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"24'4401","reported_seq":4532,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.709510+0000","last_change":"2024-09-16T14:41:44.709614+0000","last_active":"2024-09-16T14:41:44.709510+0000","last_peered":"2024-09-16T14:41:44.709510+0000","last_clean":"2024-09-16T14:41:44.709510+0000","last_became_active":"2024-09-16T14:37:23.866604+0000","last_became_peered":"2024-09-16T14:37:23.866604+0000","last_unstale":"2024-09-16T14:41:44.709510+0000","last_undegraded":"2024-09-16T14:41:44.709510+0000","last_fullsized":"2024-09-16T14:41:44.709510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4401","last_scrub_stamp":"2024-09-16T14:41:44.709488+0000","last_deep_scrub":"24'4401","last_deep_scrub_stamp":"2024-09-16T14:41:44.709488+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.709488+0000","objects_scrubbed":27,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:18:39.167197+0000","scrub_duration":0.34308872699999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109183504,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":4368,"num_write_kb":166111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'6948","reported_seq":6980,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.878641+0000","last_change":"2024-09-16T14:41:44.878746+0000","last_active":"2024-09-16T14:41:44.878641+0000","last_peered":"2024-09-16T14:41:44.878641+0000","last_clean":"2024-09-16T14:41:44.878641+0000","last_became_active":"2024-09-16T14:37:23.871022+0000","last_became_peered":"2024-09-16T14:37:23.871022+0000","last_unstale":"2024-09-16T14:41:44.878641+0000","last_undegraded":"2024-09-16T14:41:44.878641+0000","last_fullsized":"2024-09-16T14:41:44.878641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6948","last_scrub_stamp":"2024-09-16T14:41:44.878619+0000","last_deep_scrub":"24'6948","last_deep_scrub_stamp":"2024-09-16T14:41:44.878619+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.878619+0000","objects_scrubbed":28,"log_size":6948,"log_dups_size":0,"ondisk_log_size":6948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:44.621249+0000","scrub_duration":0.420769014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111198208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6926,"num_write_kb":195181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'5468","reported_seq":5498,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.144690+0000","last_change":"2024-09-16T14:41:50.144882+0000","last_active":"2024-09-16T14:41:50.144690+0000","last_peered":"2024-09-16T14:41:50.144690+0000","last_clean":"2024-09-16T14:41:50.144690+0000","last_became_active":"2024-09-16T14:37:23.866386+0000","last_became_peered":"2024-09-16T14:37:23.866386+0000","last_unstale":"2024-09-16T14:41:50.144690+0000","last_undegraded":"2024-09-16T14:41:50.144690+0000","last_fullsized":"2024-09-16T14:41:50.144690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5468","last_scrub_stamp":"2024-09-16T14:41:50.144654+0000","last_deep_scrub":"24'5468","last_deep_scrub_stamp":"2024-09-16T14:41:50.144654+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.144654+0000","objects_scrubbed":23,"log_size":5468,"log_dups_size":0,"ondisk_log_size":5468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:52:49.515938+0000","scrub_duration":0.30645684099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":5404,"num_write_kb":164450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:47.829513+0000","last_change":"2024-09-16T14:41:47.829765+0000","last_active":"2024-09-16T14:41:47.829513+0000","last_peered":"2024-09-16T14:41:47.829513+0000","last_clean":"2024-09-16T14:41:47.829513+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:41:47.829513+0000","last_undegraded":"2024-09-16T14:41:47.829513+0000","last_fullsized":"2024-09-16T14:41:47.829513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:47.829462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:47.829462+0000","last_clean_scrub_stamp":"2024-09-16T14:41:47.829462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:45.981457+0000","scrub_duration":0.003130875,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4826","reported_seq":4854,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.501610+0000","last_change":"2024-09-16T14:41:43.501610+0000","last_active":"2024-09-16T14:41:43.501610+0000","last_peered":"2024-09-16T14:41:43.501610+0000","last_clean":"2024-09-16T14:41:43.501610+0000","last_became_active":"2024-09-16T14:37:23.874796+0000","last_became_peered":"2024-09-16T14:37:23.874796+0000","last_unstale":"2024-09-16T14:41:43.501610+0000","last_undegraded":"2024-09-16T14:41:43.501610+0000","last_fullsized":"2024-09-16T14:41:43.501610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4826","last_scrub_stamp":"2024-09-16T14:41:43.501402+0000","last_deep_scrub":"24'4826","last_deep_scrub_stamp":"2024-09-16T14:41:43.501402+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.501402+0000","objects_scrubbed":25,"log_size":4826,"log_dups_size":0,"ondisk_log_size":4826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:53.034305+0000","scrub_duration":0.34031714699999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4775,"num_write_kb":162435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.192066+0000","last_change":"2024-09-16T14:41:42.192238+0000","last_active":"2024-09-16T14:41:42.192066+0000","last_peered":"2024-09-16T14:41:42.192066+0000","last_clean":"2024-09-16T14:41:42.192066+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:41:42.192066+0000","last_undegraded":"2024-09-16T14:41:42.192066+0000","last_fullsized":"2024-09-16T14:41:42.192066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:42.192014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:42.192014+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.192014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:51.135209+0000","scrub_duration":0.0035016019999999999,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'3481","reported_seq":3507,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:55.229093+0000","last_change":"2024-09-16T14:41:55.229326+0000","last_active":"2024-09-16T14:41:55.229093+0000","last_peered":"2024-09-16T14:41:55.229093+0000","last_clean":"2024-09-16T14:41:55.229093+0000","last_became_active":"2024-09-16T14:37:23.874901+0000","last_became_peered":"2024-09-16T14:37:23.874901+0000","last_unstale":"2024-09-16T14:41:55.229093+0000","last_undegraded":"2024-09-16T14:41:55.229093+0000","last_fullsized":"2024-09-16T14:41:55.229093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3481","last_scrub_stamp":"2024-09-16T14:41:55.229054+0000","last_deep_scrub":"24'3481","last_deep_scrub_stamp":"2024-09-16T14:41:55.229054+0000","last_clean_scrub_stamp":"2024-09-16T14:41:55.229054+0000","objects_scrubbed":21,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:26:34.106140+0000","scrub_duration":0.27552478000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3408,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:48.856966+0000","last_change":"2024-09-16T14:41:48.857179+0000","last_active":"2024-09-16T14:41:48.856966+0000","last_peered":"2024-09-16T14:41:48.856966+0000","last_clean":"2024-09-16T14:41:48.856966+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:41:48.856966+0000","last_undegraded":"2024-09-16T14:41:48.856966+0000","last_fullsized":"2024-09-16T14:41:48.856966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:48.856912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:48.856912+0000","last_clean_scrub_stamp":"2024-09-16T14:41:48.856912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:13.782381+0000","scrub_duration":0.0028805469999999998,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'5629","reported_seq":5674,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:45.947063+0000","last_change":"2024-09-16T14:41:45.947221+0000","last_active":"2024-09-16T14:41:45.947063+0000","last_peered":"2024-09-16T14:41:45.947063+0000","last_clean":"2024-09-16T14:41:45.947063+0000","last_became_active":"2024-09-16T14:37:23.871068+0000","last_became_peered":"2024-09-16T14:37:23.871068+0000","last_unstale":"2024-09-16T14:41:45.947063+0000","last_undegraded":"2024-09-16T14:41:45.947063+0000","last_fullsized":"2024-09-16T14:41:45.947063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5629","last_scrub_stamp":"2024-09-16T14:41:45.947038+0000","last_deep_scrub":"24'5629","last_deep_scrub_stamp":"2024-09-16T14:41:45.947038+0000","last_clean_scrub_stamp":"2024-09-16T14:41:45.947038+0000","objects_scrubbed":33,"log_size":5629,"log_dups_size":0,"ondisk_log_size":5629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:47:40.147412+0000","scrub_duration":0.44985055000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":5614,"num_write_kb":199780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.805782+0000","last_change":"2024-09-16T14:41:42.805989+0000","last_active":"2024-09-16T14:41:42.805782+0000","last_peered":"2024-09-16T14:41:42.805782+0000","last_clean":"2024-09-16T14:41:42.805782+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:41:42.805782+0000","last_undegraded":"2024-09-16T14:41:42.805782+0000","last_fullsized":"2024-09-16T14:41:42.805782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:42.805733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:42.805733+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.805733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:07:54.426696+0000","scrub_duration":0.0031812950000000002,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'4178","reported_seq":4215,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.679697+0000","last_change":"2024-09-16T14:41:43.679830+0000","last_active":"2024-09-16T14:41:43.679697+0000","last_peered":"2024-09-16T14:41:43.679697+0000","last_clean":"2024-09-16T14:41:43.679697+0000","last_became_active":"2024-09-16T14:37:23.871465+0000","last_became_peered":"2024-09-16T14:37:23.871465+0000","last_unstale":"2024-09-16T14:41:43.679697+0000","last_undegraded":"2024-09-16T14:41:43.679697+0000","last_fullsized":"2024-09-16T14:41:43.679697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4178","last_scrub_stamp":"2024-09-16T14:41:43.679662+0000","last_deep_scrub":"24'4178","last_deep_scrub_stamp":"2024-09-16T14:41:43.679662+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.679662+0000","objects_scrubbed":25,"log_size":4178,"log_dups_size":0,"ondisk_log_size":4178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:58:00.527289+0000","scrub_duration":0.35579638800000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":4172,"num_write_kb":171144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"24'3360","reported_seq":3411,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:40.799630+0000","last_change":"2024-09-16T14:41:40.799773+0000","last_active":"2024-09-16T14:41:40.799630+0000","last_peered":"2024-09-16T14:41:40.799630+0000","last_clean":"2024-09-16T14:41:40.799630+0000","last_became_active":"2024-09-16T14:37:23.872385+0000","last_became_peered":"2024-09-16T14:37:23.872385+0000","last_unstale":"2024-09-16T14:41:40.799630+0000","last_undegraded":"2024-09-16T14:41:40.799630+0000","last_fullsized":"2024-09-16T14:41:40.799630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3360","last_scrub_stamp":"2024-09-16T14:41:40.799591+0000","last_deep_scrub":"24'3360","last_deep_scrub_stamp":"2024-09-16T14:41:40.799591+0000","last_clean_scrub_stamp":"2024-09-16T14:41:40.799591+0000","objects_scrubbed":26,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:46.893929+0000","scrub_duration":0.280599771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96731664,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":85,"num_read_kb":129,"num_write":3384,"num_write_kb":160971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"24'3","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:45.772699+0000","last_change":"2024-09-16T14:41:45.772852+0000","last_active":"2024-09-16T14:41:45.772699+0000","last_peered":"2024-09-16T14:41:45.772699+0000","last_clean":"2024-09-16T14:41:45.772699+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:41:45.772699+0000","last_undegraded":"2024-09-16T14:41:45.772699+0000","last_fullsized":"2024-09-16T14:41:45.772699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-09-16T14:41:45.772623+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-09-16T14:41:45.772623+0000","last_clean_scrub_stamp":"2024-09-16T14:41:45.772623+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:20.156958+0000","scrub_duration":0.0055674219999999998,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"24'3362","reported_seq":3396,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:02.033330+0000","last_change":"2024-09-16T14:42:02.033464+0000","last_active":"2024-09-16T14:42:02.033330+0000","last_peered":"2024-09-16T14:42:02.033330+0000","last_clean":"2024-09-16T14:42:02.033330+0000","last_became_active":"2024-09-16T14:37:23.874911+0000","last_became_peered":"2024-09-16T14:37:23.874911+0000","last_unstale":"2024-09-16T14:42:02.033330+0000","last_undegraded":"2024-09-16T14:42:02.033330+0000","last_fullsized":"2024-09-16T14:42:02.033330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3362","last_scrub_stamp":"2024-09-16T14:42:02.033306+0000","last_deep_scrub":"24'3362","last_deep_scrub_stamp":"2024-09-16T14:42:02.033306+0000","last_clean_scrub_stamp":"2024-09-16T14:42:02.033306+0000","objects_scrubbed":22,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:47:45.357450+0000","scrub_duration":0.275489225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3305,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.138499+0000","last_change":"2024-09-16T14:41:44.138694+0000","last_active":"2024-09-16T14:41:44.138499+0000","last_peered":"2024-09-16T14:41:44.138499+0000","last_clean":"2024-09-16T14:41:44.138499+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:41:44.138499+0000","last_undegraded":"2024-09-16T14:41:44.138499+0000","last_fullsized":"2024-09-16T14:41:44.138499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:44.138452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:44.138452+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.138452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:13:46.396042+0000","scrub_duration":0.002382173,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'4105","reported_seq":4133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.826521+0000","last_change":"2024-09-16T14:41:43.826668+0000","last_active":"2024-09-16T14:41:43.826521+0000","last_peered":"2024-09-16T14:41:43.826521+0000","last_clean":"2024-09-16T14:41:43.826521+0000","last_became_active":"2024-09-16T14:37:23.875930+0000","last_became_peered":"2024-09-16T14:37:23.875930+0000","last_unstale":"2024-09-16T14:41:43.826521+0000","last_undegraded":"2024-09-16T14:41:43.826521+0000","last_fullsized":"2024-09-16T14:41:43.826521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4105","last_scrub_stamp":"2024-09-16T14:41:43.826496+0000","last_deep_scrub":"24'4105","last_deep_scrub_stamp":"2024-09-16T14:41:43.826496+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.826496+0000","objects_scrubbed":25,"log_size":4105,"log_dups_size":0,"ondisk_log_size":4105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:20:19.169844+0000","scrub_duration":0.33176346099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":169350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.781917+0000","last_change":"2024-09-16T14:41:44.782050+0000","last_active":"2024-09-16T14:41:44.781917+0000","last_peered":"2024-09-16T14:41:44.781917+0000","last_clean":"2024-09-16T14:41:44.781917+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:41:44.781917+0000","last_undegraded":"2024-09-16T14:41:44.781917+0000","last_fullsized":"2024-09-16T14:41:44.781917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:44.781876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:44.781876+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.781876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:51:01.410455+0000","scrub_duration":0.003466397,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'4630","reported_seq":4660,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.393244+0000","last_change":"2024-09-16T14:41:44.393425+0000","last_active":"2024-09-16T14:41:44.393244+0000","last_peered":"2024-09-16T14:41:44.393244+0000","last_clean":"2024-09-16T14:41:44.393244+0000","last_became_active":"2024-09-16T14:37:23.873060+0000","last_became_peered":"2024-09-16T14:37:23.873060+0000","last_unstale":"2024-09-16T14:41:44.393244+0000","last_undegraded":"2024-09-16T14:41:44.393244+0000","last_fullsized":"2024-09-16T14:41:44.393244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4630","last_scrub_stamp":"2024-09-16T14:41:44.393205+0000","last_deep_scrub":"24'4630","last_deep_scrub_stamp":"2024-09-16T14:41:44.393205+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.393205+0000","objects_scrubbed":24,"log_size":4630,"log_dups_size":0,"ondisk_log_size":4630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:48:05.437769+0000","scrub_duration":0.277857513,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96536232,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12,"num_read_kb":135,"num_write":4615,"num_write_kb":187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:46.800960+0000","last_change":"2024-09-16T14:41:46.801158+0000","last_active":"2024-09-16T14:41:46.800960+0000","last_peered":"2024-09-16T14:41:46.800960+0000","last_clean":"2024-09-16T14:41:46.800960+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:41:46.800960+0000","last_undegraded":"2024-09-16T14:41:46.800960+0000","last_fullsized":"2024-09-16T14:41:46.800960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-09-16T14:41:46.800904+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-09-16T14:41:46.800904+0000","last_clean_scrub_stamp":"2024-09-16T14:41:46.800904+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:55.829798+0000","scrub_duration":0.0057763729999999996,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:40.578465+0000","last_change":"2024-09-16T14:41:40.578601+0000","last_active":"2024-09-16T14:41:40.578465+0000","last_peered":"2024-09-16T14:41:40.578465+0000","last_clean":"2024-09-16T14:41:40.578465+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:41:40.578465+0000","last_undegraded":"2024-09-16T14:41:40.578465+0000","last_fullsized":"2024-09-16T14:41:40.578465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-09-16T14:41:40.578430+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-09-16T14:41:40.578430+0000","last_clean_scrub_stamp":"2024-09-16T14:41:40.578430+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:54:15.136171+0000","scrub_duration":0.0091132959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'3728","reported_seq":3760,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.275480+0000","last_change":"2024-09-16T14:41:50.275624+0000","last_active":"2024-09-16T14:41:50.275480+0000","last_peered":"2024-09-16T14:41:50.275480+0000","last_clean":"2024-09-16T14:41:50.275480+0000","last_became_active":"2024-09-16T14:37:23.874809+0000","last_became_peered":"2024-09-16T14:37:23.874809+0000","last_unstale":"2024-09-16T14:41:50.275480+0000","last_undegraded":"2024-09-16T14:41:50.275480+0000","last_fullsized":"2024-09-16T14:41:50.275480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3728","last_scrub_stamp":"2024-09-16T14:41:50.275454+0000","last_deep_scrub":"24'3728","last_deep_scrub_stamp":"2024-09-16T14:41:50.275454+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.275454+0000","objects_scrubbed":24,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:44:35.091956+0000","scrub_duration":0.27504435500000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88155160,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":3655,"num_write_kb":140764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"24'8805","reported_seq":8956,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:57.304875+0000","last_change":"2024-09-16T14:41:57.304998+0000","last_active":"2024-09-16T14:41:57.304875+0000","last_peered":"2024-09-16T14:41:57.304875+0000","last_clean":"2024-09-16T14:41:57.304875+0000","last_became_active":"2024-09-16T14:37:23.870990+0000","last_became_peered":"2024-09-16T14:37:23.870990+0000","last_unstale":"2024-09-16T14:41:57.304875+0000","last_undegraded":"2024-09-16T14:41:57.304875+0000","last_fullsized":"2024-09-16T14:41:57.304875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8805","last_scrub_stamp":"2024-09-16T14:41:57.304852+0000","last_deep_scrub":"24'8805","last_deep_scrub_stamp":"2024-09-16T14:41:57.304852+0000","last_clean_scrub_stamp":"2024-09-16T14:41:57.304852+0000","objects_scrubbed":35,"log_size":8805,"log_dups_size":0,"ondisk_log_size":8805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:32:57.646860+0000","scrub_duration":0.41306886999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":416,"num_read_kb":374,"num_write":6755,"num_write_kb":203154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'4584","reported_seq":4599,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:41.111089+0000","last_change":"2024-09-16T14:37:23.864603+0000","last_active":"2024-09-16T14:41:41.111089+0000","last_peered":"2024-09-16T14:41:41.111089+0000","last_clean":"2024-09-16T14:41:41.111089+0000","last_became_active":"2024-09-16T14:37:23.864034+0000","last_became_peered":"2024-09-16T14:37:23.864034+0000","last_unstale":"2024-09-16T14:41:41.111089+0000","last_undegraded":"2024-09-16T14:41:41.111089+0000","last_fullsized":"2024-09-16T14:41:41.111089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":4584,"log_dups_size":0,"ondisk_log_size":4584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4557,"num_write_kb":210052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"24'3949","reported_seq":3977,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:46.440421+0000","last_change":"2024-09-16T14:41:46.440421+0000","last_active":"2024-09-16T14:41:46.440421+0000","last_peered":"2024-09-16T14:41:46.440421+0000","last_clean":"2024-09-16T14:41:46.440421+0000","last_became_active":"2024-09-16T14:37:23.874573+0000","last_became_peered":"2024-09-16T14:37:23.874573+0000","last_unstale":"2024-09-16T14:41:46.440421+0000","last_undegraded":"2024-09-16T14:41:46.440421+0000","last_fullsized":"2024-09-16T14:41:46.440421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3949","last_scrub_stamp":"2024-09-16T14:41:46.440233+0000","last_deep_scrub":"24'3949","last_deep_scrub_stamp":"2024-09-16T14:41:46.440233+0000","last_clean_scrub_stamp":"2024-09-16T14:41:46.440233+0000","objects_scrubbed":25,"log_size":3949,"log_dups_size":0,"ondisk_log_size":3949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:05:54.948239+0000","scrub_duration":0.31215353400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":193410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"24'2831","reported_seq":2857,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.563732+0000","last_change":"2024-09-16T14:41:50.563732+0000","last_active":"2024-09-16T14:41:50.563732+0000","last_peered":"2024-09-16T14:41:50.563732+0000","last_clean":"2024-09-16T14:41:50.563732+0000","last_became_active":"2024-09-16T14:37:23.874099+0000","last_became_peered":"2024-09-16T14:37:23.874099+0000","last_unstale":"2024-09-16T14:41:50.563732+0000","last_undegraded":"2024-09-16T14:41:50.563732+0000","last_fullsized":"2024-09-16T14:41:50.563732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2831","last_scrub_stamp":"2024-09-16T14:41:50.563592+0000","last_deep_scrub":"24'2831","last_deep_scrub_stamp":"2024-09-16T14:41:50.563592+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.563592+0000","objects_scrubbed":19,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:38.275643+0000","scrub_duration":0.19784163799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78251856,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":122330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"24'4001","reported_seq":4040,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:51.316025+0000","last_change":"2024-09-16T14:41:51.316025+0000","last_active":"2024-09-16T14:41:51.316025+0000","last_peered":"2024-09-16T14:41:51.316025+0000","last_clean":"2024-09-16T14:41:51.316025+0000","last_became_active":"2024-09-16T14:37:23.865656+0000","last_became_peered":"2024-09-16T14:37:23.865656+0000","last_unstale":"2024-09-16T14:41:51.316025+0000","last_undegraded":"2024-09-16T14:41:51.316025+0000","last_fullsized":"2024-09-16T14:41:51.316025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4001","last_scrub_stamp":"2024-09-16T14:41:51.315879+0000","last_deep_scrub":"24'4001","last_deep_scrub_stamp":"2024-09-16T14:41:51.315879+0000","last_clean_scrub_stamp":"2024-09-16T14:41:51.315879+0000","objects_scrubbed":33,"log_size":4001,"log_dups_size":0,"ondisk_log_size":4001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:11:20.795566+0000","scrub_duration":0.43038587299999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":36,"num_write":3967,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'4582","reported_seq":4720,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.624914+0000","last_change":"2024-09-16T14:41:42.624914+0000","last_active":"2024-09-16T14:41:42.624914+0000","last_peered":"2024-09-16T14:41:42.624914+0000","last_clean":"2024-09-16T14:41:42.624914+0000","last_became_active":"2024-09-16T14:37:23.868935+0000","last_became_peered":"2024-09-16T14:37:23.868935+0000","last_unstale":"2024-09-16T14:41:42.624914+0000","last_undegraded":"2024-09-16T14:41:42.624914+0000","last_fullsized":"2024-09-16T14:41:42.624914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4582","last_scrub_stamp":"2024-09-16T14:41:42.624775+0000","last_deep_scrub":"24'4582","last_deep_scrub_stamp":"2024-09-16T14:41:42.624775+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.624775+0000","objects_scrubbed":25,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:18:41.793270+0000","scrub_duration":0.28491039899999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100073992,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":376,"num_read_kb":299,"num_write":4840,"num_write_kb":173375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'2718","reported_seq":2746,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.737897+0000","last_change":"2024-09-16T14:41:43.737897+0000","last_active":"2024-09-16T14:41:43.737897+0000","last_peered":"2024-09-16T14:41:43.737897+0000","last_clean":"2024-09-16T14:41:43.737897+0000","last_became_active":"2024-09-16T14:37:23.868262+0000","last_became_peered":"2024-09-16T14:37:23.868262+0000","last_unstale":"2024-09-16T14:41:43.737897+0000","last_undegraded":"2024-09-16T14:41:43.737897+0000","last_fullsized":"2024-09-16T14:41:43.737897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2718","last_scrub_stamp":"2024-09-16T14:41:43.737651+0000","last_deep_scrub":"24'2718","last_deep_scrub_stamp":"2024-09-16T14:41:43.737651+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.737651+0000","objects_scrubbed":20,"log_size":2718,"log_dups_size":0,"ondisk_log_size":2718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:03:57.840849+0000","scrub_duration":0.23583225399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79823376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2657,"num_write_kb":119691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'3820","reported_seq":3853,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:46.042126+0000","last_change":"2024-09-16T14:41:46.042236+0000","last_active":"2024-09-16T14:41:46.042126+0000","last_peered":"2024-09-16T14:41:46.042126+0000","last_clean":"2024-09-16T14:41:46.042126+0000","last_became_active":"2024-09-16T14:37:24.065966+0000","last_became_peered":"2024-09-16T14:37:24.065966+0000","last_unstale":"2024-09-16T14:41:46.042126+0000","last_undegraded":"2024-09-16T14:41:46.042126+0000","last_fullsized":"2024-09-16T14:41:46.042126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3820","last_scrub_stamp":"2024-09-16T14:41:46.042104+0000","last_deep_scrub":"24'3820","last_deep_scrub_stamp":"2024-09-16T14:41:46.042104+0000","last_clean_scrub_stamp":"2024-09-16T14:41:46.042104+0000","objects_scrubbed":31,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:10.389787+0000","scrub_duration":0.378229027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":3750,"num_write_kb":213570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"22'2640","reported_seq":2654,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:36.323308+0000","last_change":"2024-09-16T14:37:23.866814+0000","last_active":"2024-09-16T14:41:36.323308+0000","last_peered":"2024-09-16T14:41:36.323308+0000","last_clean":"2024-09-16T14:41:36.323308+0000","last_became_active":"2024-09-16T14:37:23.866545+0000","last_became_peered":"2024-09-16T14:37:23.866545+0000","last_unstale":"2024-09-16T14:41:36.323308+0000","last_undegraded":"2024-09-16T14:41:36.323308+0000","last_fullsized":"2024-09-16T14:41:36.323308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:37:23.322184+0000","last_clean_scrub_stamp":"2024-09-16T14:37:23.322184+0000","objects_scrubbed":0,"log_size":2640,"log_dups_size":0,"ondisk_log_size":2640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":119555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"24'2427","reported_seq":2452,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.784769+0000","last_change":"2024-09-16T14:41:44.784952+0000","last_active":"2024-09-16T14:41:44.784769+0000","last_peered":"2024-09-16T14:41:44.784769+0000","last_clean":"2024-09-16T14:41:44.784769+0000","last_became_active":"2024-09-16T14:37:23.873069+0000","last_became_peered":"2024-09-16T14:37:23.873069+0000","last_unstale":"2024-09-16T14:41:44.784769+0000","last_undegraded":"2024-09-16T14:41:44.784769+0000","last_fullsized":"2024-09-16T14:41:44.784769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2427","last_scrub_stamp":"2024-09-16T14:41:44.784733+0000","last_deep_scrub":"24'2427","last_deep_scrub_stamp":"2024-09-16T14:41:44.784733+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.784733+0000","objects_scrubbed":22,"log_size":2427,"log_dups_size":0,"ondisk_log_size":2427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:16:05.474373+0000","scrub_duration":0.26607209100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88145920,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2351,"num_write_kb":101825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"24'7789","reported_seq":7818,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:02.344597+0000","last_change":"2024-09-16T14:42:02.344745+0000","last_active":"2024-09-16T14:42:02.344597+0000","last_peered":"2024-09-16T14:42:02.344597+0000","last_clean":"2024-09-16T14:42:02.344597+0000","last_became_active":"2024-09-16T14:37:23.868469+0000","last_became_peered":"2024-09-16T14:37:23.868469+0000","last_unstale":"2024-09-16T14:42:02.344597+0000","last_undegraded":"2024-09-16T14:42:02.344597+0000","last_fullsized":"2024-09-16T14:42:02.344597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7789","last_scrub_stamp":"2024-09-16T14:42:02.344571+0000","last_deep_scrub":"24'7789","last_deep_scrub_stamp":"2024-09-16T14:42:02.344571+0000","last_clean_scrub_stamp":"2024-09-16T14:42:02.344571+0000","objects_scrubbed":31,"log_size":7789,"log_dups_size":0,"ondisk_log_size":7789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:31.932621+0000","scrub_duration":0.47415724799999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":7743,"num_write_kb":271203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3548455160,"num_objects":873,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":873,"num_whiteouts":0,"num_read":2563,"num_read_kb":2579,"num_write":150750,"num_write_kb":5600677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6780297216,"data_stored":6795560056,"data_compressed":70367536,"data_compressed_allocated":73326592,"data_compressed_original":92856320,"omap_allocated":0,"internal_metadata":0},"log_size":153349,"ondisk_log_size":153349,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542204,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1043960,"kb_used_data":778288,"kb_used_omap":1,"kb_used_meta":265662,"kb_avail":93327880,"statfs":{"total":96636764160,"available":95567749120,"internally_reserved":0,"allocated":796966912,"data_stored":799458522,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":1593,"internal_metadata":272038343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.68100000000000005},"min":{"1min":0.40200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.3660000000000001,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.125}]},{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94899999999999995,"15min":1.0940000000000001},"min":{"1min":0.503,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1519999999999999,"5min":10.654999999999999,"15min":10.654999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70799999999999996,"15min":0.65300000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.522,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.008}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.745,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.86899999999999999,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0960000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.052}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.365,"15min":1.3280000000000001},"min":{"1min":0.45400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.571,"5min":28.141999999999999,"15min":28.141999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.0800000000000001,"15min":0.81799999999999995},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.069,"5min":28.109999999999999,"15min":28.109999999999999},"last":1.028}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90000000000000002,"15min":0.91800000000000004},"min":{"1min":0.41599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.208,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.876},"min":{"1min":0.434,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.256,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.087}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.202,"15min":1.46},"min":{"1min":0.66700000000000004,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1719999999999999,"5min":14.289,"15min":14.289},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.92100000000000004},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.4710000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.85299999999999998}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96799999999999997,"15min":0.91300000000000003},"min":{"1min":0.57299999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6279999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.95199999999999996,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2949999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":0.70499999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1148008,"kb_used_data":850336,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93223832,"statfs":{"total":96636764160,"available":95461203968,"internally_reserved":0,"allocated":870744064,"data_stored":872705543,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54100000000000004,"15min":0.496},"min":{"1min":0.251,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.84199999999999997,"5min":1.857,"15min":1.857},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.53100000000000003},"min":{"1min":0.35799999999999998,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0069999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.84399999999999997,"15min":1.0529999999999999},"min":{"1min":0.255,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.92700000000000005,"5min":12.141,"15min":12.141},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.64900000000000002,"15min":0.60699999999999998},"min":{"1min":0.318,"5min":0.224,"15min":0.224},"max":{"1min":1.1830000000000001,"5min":1.657,"15min":1.657},"last":0.85999999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.61399999999999999},"min":{"1min":0.308,"5min":0.224,"15min":0.224},"max":{"1min":0.86199999999999999,"5min":1.077,"15min":1.077},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.46899999999999997,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.89500000000000002}]},{"osd":4,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.93400000000000005,"15min":0.85599999999999998},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.147,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":1.0600000000000001,"15min":0.997},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3009999999999999,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":1.113}]},{"osd":5,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.41199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.343,"5min":1.786,"15min":1.786},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":0.95799999999999996,"15min":0.86399999999999999},"min":{"1min":0.40699999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.1849999999999996,"5min":5.7869999999999999,"15min":5.7869999999999999},"last":1.0289999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91400000000000003,"15min":0.89200000000000002},"min":{"1min":0.41899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4370000000000001,"5min":1.968,"15min":1.968},"last":1.135},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":0.94599999999999995},"min":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.389,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.1819999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.323,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.159},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94799999999999995,"15min":0.89700000000000002},"min":{"1min":0.498,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3089999999999999,"5min":1.7,"15min":1.7},"last":0.96299999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191468,"kb_used_data":935652,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93180372,"statfs":{"total":96636764160,"available":95416700928,"internally_reserved":0,"allocated":958107648,"data_stored":959426311,"data_compressed":13128965,"data_compressed_allocated":13701120,"data_compressed_original":15773696,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.70299999999999996,"15min":0.79800000000000004},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":1.181,"5min":3.02,"15min":3.02},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71799999999999997,"15min":0.80200000000000005},"min":{"1min":0.26400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":1.0920000000000001,"5min":3.141,"15min":3.141},"last":0.83999999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.82199999999999995,"15min":1.0369999999999999},"min":{"1min":0.217,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.96899999999999997,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.873,"15min":1.0580000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.202,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.88600000000000001}]},{"osd":3,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.427,"15min":1.383},"min":{"1min":0.32400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.82299999999999995,"5min":48.195,"15min":48.195},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.748,"5min":1.4379999999999999,"15min":2.069},"min":{"1min":0.31,"5min":0.246,"15min":0.246},"max":{"1min":1.2609999999999999,"5min":25.248000000000001,"15min":25.248000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3759999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91400000000000003,"15min":0.88600000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.544,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.109}]},{"osd":5,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.024,"15min":1.1120000000000001},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.206,"5min":5.819,"15min":5.819},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88,"15min":0.83199999999999996},"min":{"1min":0.59499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.371,"5min":1.611,"15min":1.611},"last":1.004}]},{"osd":6,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.94699999999999995},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6479999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.59399999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3620000000000001,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":1.1930000000000001}]},{"osd":7,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.466,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.238},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":0.875},"min":{"1min":0.51300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3240000000000001,"5min":1.544,"15min":1.544},"last":1.0609999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542204,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1255284,"kb_used_data":921516,"kb_used_omap":1,"kb_used_meta":333758,"kb_avail":93116556,"statfs":{"total":96636764160,"available":95351353344,"internally_reserved":0,"allocated":943632384,"data_stored":944635399,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":1594,"internal_metadata":341768646},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.73299999999999998},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.88700000000000001,"5min":4.9779999999999998,"15min":4.9779999999999998},"last":0.68799999999999994}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91300000000000003,"5min":5.0839999999999996,"15min":5.0839999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.96699999999999997,"15min":1.149},"min":{"1min":0.307,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0449999999999999,"5min":7.6040000000000001,"15min":7.6040000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.262,"15min":1.8340000000000001},"min":{"1min":0.28100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":17.472000000000001,"15min":17.472000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.78200000000000003},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.254},"max":{"1min":1.073,"5min":3.9649999999999999,"15min":3.9649999999999999},"last":0.78000000000000003}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.82799999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.224,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.008}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.1739999999999999,"15min":1.423},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4239999999999999,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.02,"5min":0.998,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":5.9429999999999996,"15min":5.9429999999999996},"last":0.88900000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95199999999999996,"15min":0.92000000000000004},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3300000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.077},{"interface":"front","average":{"1min":1.022,"5min":1.173,"15min":1.363},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.4970000000000001,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":1.0569999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0880000000000001,"15min":1.1759999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.528,"5min":7.5819999999999999,"15min":7.5819999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.079},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4870000000000001,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":1.1220000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":531228,"kb_used_data":432020,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93840612,"statfs":{"total":96636764160,"available":96092786688,"internally_reserved":0,"allocated":442388480,"data_stored":444222051,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":1589,"internal_metadata":101579211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.1639999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.85399999999999998,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1180000000000001,"5min":8.6959999999999997,"15min":8.6959999999999997},"last":1.0409999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76000000000000001,"15min":0.67700000000000005},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.907,"15min":1.907},"last":1.22},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78600000000000003,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.999,"5min":5.798,"15min":5.798},"last":0.67900000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.78600000000000003},"min":{"1min":0.56200000000000006,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.169,"5min":4.109,"15min":4.109},"last":1.268},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.327,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.1160000000000001}]},{"osd":3,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.498,"15min":1.98},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":24.472000000000001,"15min":24.472000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0740000000000001,"15min":1.258},"min":{"1min":0.55300000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1240000000000001,"5min":6.6139999999999999,"15min":6.6139999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82699999999999996,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.29,"5min":1.377,"15min":1.377},"last":1.393},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.77000000000000002},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.413,"5min":1.581,"15min":1.581},"last":0.98199999999999998}]},{"osd":5,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.83399999999999996},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.339,"5min":1.712,"15min":1.712},"last":1.3089999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.93000000000000005,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2010000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2430000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.008,"15min":0.93999999999999995},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.351},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.248,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.194}]}]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1226124,"kb_used_data":880068,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93145716,"statfs":{"total":96636764160,"available":95381213184,"internally_reserved":0,"allocated":901189632,"data_stored":902465855,"data_compressed":6836315,"data_compressed_allocated":7131136,"data_compressed_original":9027584,"omap_allocated":1594,"internal_metadata":354351558},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76500000000000001,"15min":0.69499999999999995},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.161,"5min":6.4800000000000004,"15min":6.4800000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.82299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3620000000000001,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.96399999999999997,"15min":1.034},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.046,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":1.0329999999999999},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":0.91100000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82899999999999996,"15min":0.78100000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1910000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.753},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84599999999999997},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.244,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2250000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":0.97399999999999998}]},{"osd":4,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.145,"5min":1.319,"15min":1.319},"last":1.111},{"interface":"front","average":{"1min":0.93700000000000006,"5min":4.2720000000000002,"15min":7.6070000000000002},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.399,"5min":91.039000000000001,"15min":91.039000000000001},"last":1.0700000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99199999999999999,"15min":0.94899999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.1299999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.006,"15min":0.94299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.337,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.1000000000000001,"15min":1.024},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.593,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.0029999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":989688,"kb_used_data":729776,"kb_used_omap":1,"kb_used_meta":259902,"kb_avail":93382152,"statfs":{"total":96636764160,"available":95623323648,"internally_reserved":0,"allocated":747290624,"data_stored":750299371,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":1594,"internal_metadata":266140102},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.82599999999999996,"15min":0.93799999999999994},"min":{"1min":0.38600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.097,"5min":4.617,"15min":4.617},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66900000000000004,"15min":0.623},"min":{"1min":0.32800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.94499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3520000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.95099999999999996,"15min":1.117},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.212,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":0.83199999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.40899999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":2.528,"15min":2.528},"last":0.753},{"interface":"front","average":{"1min":0.872,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.4530000000000001,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.94199999999999995}]},{"osd":3,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.879,"15min":0.871},"min":{"1min":0.49099999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.88600000000000001,"15min":0.879},"min":{"1min":0.45000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.278,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":1.1579999999999999}]},{"osd":5,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80500000000000005,"15min":0.749},"min":{"1min":0.40500000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1559999999999999,"5min":2.726,"15min":2.726},"last":0.874},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.55500000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.1850000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.633,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":1.129},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4330000000000001,"5min":1.782,"15min":1.782},"last":1.077}]},{"osd":7,"last update":"Mon Sep 16 14:41:15 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.044,"15min":1.1319999999999999},"min":{"1min":0.49099999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.131,"5min":4.556,"15min":4.556},"last":1.101},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0169999999999999,"15min":0.93600000000000005},"min":{"1min":0.5,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.335,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2470000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483556,"kb_used_data":1095644,"kb_used_omap":1,"kb_used_meta":387902,"kb_avail":92888284,"statfs":{"total":96636764160,"available":95117602816,"internally_reserved":0,"allocated":1121939456,"data_stored":1124037310,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":1592,"internal_metadata":397212104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.621},"min":{"1min":0.27900000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.84099999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.378},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":1.0269999999999999},"min":{"1min":0.34499999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.004,"5min":12.147,"15min":12.147},"last":0.55200000000000005}]},{"osd":1,"last update":"Mon Sep 16 14:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.28,"5min":1.718,"15min":1.718},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":0.63400000000000001},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77900000000000003,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":1.0609999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.85299999999999998},"min":{"1min":0.39300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.95299999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0920000000000001,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.5389999999999999,"15min":2.1070000000000002},"min":{"1min":0.433,"5min":0.309,"15min":0.309},"max":{"1min":1.482,"5min":29.449000000000002,"15min":29.449000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.161,"5min":8.4499999999999993,"15min":8.4499999999999993},"last":0.872}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.1479999999999999,"15min":1.042},"min":{"1min":0.432,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":11.983000000000001,"5min":11.983000000000001,"15min":11.983000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.242,"15min":1.5740000000000001},"min":{"1min":0.5,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.22,"5min":13.377000000000001,"15min":13.377000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.161,"15min":1.337},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":13.334,"15min":13.334},"last":0.629},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.569,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1499999999999999,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.7050000000000001,"5min":8.6829999999999998,"15min":8.6829999999999998},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2010000000000001,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.0070000000000001,"5min":8.7050000000000001,"15min":8.7050000000000001},"last":0.84799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":943403008,"data_stored":944556228,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":957816832,"data_stored":958818212,"data_compressed":13098947,"data_compressed_allocated":13660160,"data_compressed_original":15261696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":870514688,"data_stored":872626372,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1121705984,"data_stored":1123958120,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":747061248,"data_stored":750220200,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":900898816,"data_stored":901857756,"data_compressed":6806297,"data_compressed_allocated":7090176,"data_compressed_original":8515584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":796737536,"data_stored":799380288,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":442159104,"data_stored":444142880,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:42:03.817 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:42:03.817 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:42:03.818 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-16T14:37:23.322184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=37, tm_sec=23, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=14, tm_min=41, tm_sec=38, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T14:42:03.818 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T14:42:23.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T14:42:23.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.935+0000 7fd1f1580700 1 Processor -- start 2024-09-16T14:42:23.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.935+0000 7fd1f1580700 1 -- start start 2024-09-16T14:42:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1f1580700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec06a9b0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1ebfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd1ec06a5d0 0x7fd1ec0adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33696/0 (socket says 172.21.15.73:33696) 2024-09-16T14:42:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1ebfff700 1 -- 172.21.15.73:0/3421539170 learned_addr learned my addr 172.21.15.73:0/3421539170 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:42:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0ac900 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec0af1c0 con 0x7fd1ec140580 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331071857 0 0) 0x7fd1ec06a9b0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d40035d0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988056609 0 0) 0x7fd1ec0af1c0 con 0x7fd1ec140580 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec06a9b0 con 0x7fd1ec140580 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038144334 0 0) 0x7fd1ec0ac900 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec0af1c0 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3259882566 0 0) 0x7fd1d40035d0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 >> v1:172.21.15.73:6790/0 conn(0x7fd1ec140580 legacy=0x7fd1ec0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 >> v1:172.21.15.177:6789/0 conn(0x7fd1ec0ad4c0 legacy=0x7fd1ec14ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec0aeeb0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd1dc001610 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.0 v1:172.21.15.73:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd1dc001870 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.939+0000 7fd1eaffd700 1 -- 172.21.15.73:0/3421539170 <== mon.0 v1:172.21.15.73:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd1dc001c40 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 >> v1:172.21.15.73:6789/0 conn(0x7fd1ec06a5d0 legacy=0x7fd1ec0adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 shutdown_connections 2024-09-16T14:42:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 >> 172.21.15.73:0/3421539170 conn(0x7fd1ec0b4030 msgr2=0x7fd1ec0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:42:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 shutdown_connections 2024-09-16T14:42:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- 172.21.15.73:0/3421539170 wait complete. 2024-09-16T14:42:23.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 Processor -- start 2024-09-16T14:42:23.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- start start 2024-09-16T14:42:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec1d5f90 con 0x7fd1ec140580 2024-09-16T14:42:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec13afb0 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1f1580700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ec1d6230 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1ebfff700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7fd1ec06a5d0 0x7fd1ec1d6750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:45810/0 (socket says 172.21.15.73:45810) 2024-09-16T14:42:23.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1ebfff700 1 -- 172.21.15.73:0/3616277857 learned_addr learned my addr 172.21.15.73:0/3616277857 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110141693 0 0) 0x7fd1ec1d6230 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d80035d0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941268997 0 0) 0x7fd1ec1d5f90 con 0x7fd1ec140580 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec1d6230 con 0x7fd1ec140580 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.943+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183131589 0 0) 0x7fd1ec13afb0 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec1d5f90 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 772779823 0 0) 0x7fd1d80035d0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1ec13afb0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd1dc001bc0 con 0x7fd1ec06a5d0 2024-09-16T14:42:23.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1240528620 0 0) 0x7fd1ec1d6230 con 0x7fd1ec140580 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1d80035d0 con 0x7fd1ec140580 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd1e4001bf0 con 0x7fd1ec140580 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4286899565 0 0) 0x7fd1ec1d5f90 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd1ec1d6230 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd1e00017f0 con 0x7fd1ec0ad4c0 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2900350101 0 0) 0x7fd1d80035d0 con 0x7fd1ec140580 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 >> v1:172.21.15.73:6790/0 conn(0x7fd1ec06a5d0 legacy=0x7fd1ec1d6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 >> v1:172.21.15.177:6789/0 conn(0x7fd1ec0ad4c0 legacy=0x7fd1ec06dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec1d6e60 con 0x7fd1ec140580 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ec1d70b0 con 0x7fd1ec140580 2024-09-16T14:42:23.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd1e40020c0 con 0x7fd1ec140580 2024-09-16T14:42:23.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ec139430 con 0x7fd1ec140580 2024-09-16T14:42:23.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7fd1e4003bc0 con 0x7fd1ec140580 2024-09-16T14:42:23.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.73:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc005100 con 0x7fd1ec140580 2024-09-16T14:42:23.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.947+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7fd1e4003d20 con 0x7fd1ec140580 2024-09-16T14:42:23.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.951+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7fd1e407e5d0 con 0x7fd1ec140580 2024-09-16T14:42:23.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:23.955+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mon.0 v1:172.21.15.73:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7fd1e404bd20 con 0x7fd1ec140580 2024-09-16T14:42:24.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.123+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 --> v1:172.21.15.177:6816/2823028339 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1cc000b90 con 0x7fd1d80674a0 2024-09-16T14:42:24.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.135+0000 7fd1e8ff9700 1 -- 172.21.15.73:0/3616277857 <== mgr.4110 v1:172.21.15.177:6816/2823028339 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+154517 (unknown 2965378022 0 4229631946) 0x7fd1cc000b90 con 0x7fd1d80674a0 2024-09-16T14:42:24.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-16T14:42:24.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.139+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 >> v1:172.21.15.177:6816/2823028339 conn(0x7fd1d80674a0 legacy=0x7fd1d8069960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.139+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 >> v1:172.21.15.73:6789/0 conn(0x7fd1ec140580 legacy=0x7fd1ec1e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.139+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 shutdown_connections 2024-09-16T14:42:24.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.139+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 >> 172.21.15.73:0/3616277857 conn(0x7fd1ec0b4030 msgr2=0x7fd1ec1384c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:42:24.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.139+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 shutdown_connections 2024-09-16T14:42:24.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.139+0000 7fd1f1580700 1 -- 172.21.15.73:0/3616277857 wait complete. 2024-09-16T14:42:24.145 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-09-16T14:42:24.158 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-16T14:42:23.242944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3549045547,"num_objects":877,"num_object_clones":0,"num_object_copies":1754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":2679,"num_read_kb":2679,"num_write":150911,"num_write_kb":5603095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153561,"ondisk_log_size":153561,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8873412,"kb_used_data":6623300,"kb_used_omap":12,"kb_used_meta":2250035,"kb_avail":746101308,"statfs":{"total":773094113280,"available":764007739392,"internally_reserved":0,"allocated":6782259200,"data_stored":6797250362,"data_compressed":70427572,"data_compressed_allocated":73408512,"data_compressed_original":93880320,"omap_allocated":12744,"internal_metadata":2304036408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004141"},"pg_stats":[{"pgid":"3.1f","version":"24'4476","reported_seq":4541,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:54.100976+0000","last_change":"2024-09-16T14:41:54.101088+0000","last_active":"2024-09-16T14:41:54.100976+0000","last_peered":"2024-09-16T14:41:54.100976+0000","last_clean":"2024-09-16T14:41:54.100976+0000","last_became_active":"2024-09-16T14:37:24.063684+0000","last_became_peered":"2024-09-16T14:37:24.063684+0000","last_unstale":"2024-09-16T14:41:54.100976+0000","last_undegraded":"2024-09-16T14:41:54.100976+0000","last_fullsized":"2024-09-16T14:41:54.100976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4476","last_scrub_stamp":"2024-09-16T14:41:54.100952+0000","last_deep_scrub":"24'4476","last_deep_scrub_stamp":"2024-09-16T14:41:54.100952+0000","last_clean_scrub_stamp":"2024-09-16T14:41:54.100952+0000","objects_scrubbed":36,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:09:16.379199+0000","scrub_duration":0.37723048999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137234784,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":140,"num_read_kb":116,"num_write":4501,"num_write_kb":200999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"24'6715","reported_seq":6750,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:45.114044+0000","last_change":"2024-09-16T14:41:45.114145+0000","last_active":"2024-09-16T14:41:45.114044+0000","last_peered":"2024-09-16T14:41:45.114044+0000","last_clean":"2024-09-16T14:41:45.114044+0000","last_became_active":"2024-09-16T14:37:23.861295+0000","last_became_peered":"2024-09-16T14:37:23.861295+0000","last_unstale":"2024-09-16T14:41:45.114044+0000","last_undegraded":"2024-09-16T14:41:45.114044+0000","last_fullsized":"2024-09-16T14:41:45.114044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6715","last_scrub_stamp":"2024-09-16T14:41:45.114021+0000","last_deep_scrub":"24'6715","last_deep_scrub_stamp":"2024-09-16T14:41:45.114021+0000","last_clean_scrub_stamp":"2024-09-16T14:41:45.114021+0000","objects_scrubbed":28,"log_size":6715,"log_dups_size":0,"ondisk_log_size":6715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:48:42.607750+0000","scrub_duration":0.37396536000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115998720,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":6680,"num_write_kb":211796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'6906","reported_seq":6947,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:07.391571+0000","last_change":"2024-09-16T14:42:07.391829+0000","last_active":"2024-09-16T14:42:07.391571+0000","last_peered":"2024-09-16T14:42:07.391571+0000","last_clean":"2024-09-16T14:42:07.391571+0000","last_became_active":"2024-09-16T14:37:23.875180+0000","last_became_peered":"2024-09-16T14:37:23.875180+0000","last_unstale":"2024-09-16T14:42:07.391571+0000","last_undegraded":"2024-09-16T14:42:07.391571+0000","last_fullsized":"2024-09-16T14:42:07.391571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6906","last_scrub_stamp":"2024-09-16T14:42:07.391495+0000","last_deep_scrub":"24'6906","last_deep_scrub_stamp":"2024-09-16T14:42:07.391495+0000","last_clean_scrub_stamp":"2024-09-16T14:42:07.391495+0000","objects_scrubbed":34,"log_size":6906,"log_dups_size":0,"ondisk_log_size":6906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:25:28.081026+0000","scrub_duration":0.49778720700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134348800,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":56,"num_read_kb":105,"num_write":6978,"num_write_kb":205252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"24'4559","reported_seq":4592,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.953390+0000","last_change":"2024-09-16T14:41:50.953552+0000","last_active":"2024-09-16T14:41:50.953390+0000","last_peered":"2024-09-16T14:41:50.953390+0000","last_clean":"2024-09-16T14:41:50.953390+0000","last_became_active":"2024-09-16T14:37:23.875445+0000","last_became_peered":"2024-09-16T14:37:23.875445+0000","last_unstale":"2024-09-16T14:41:50.953390+0000","last_undegraded":"2024-09-16T14:41:50.953390+0000","last_fullsized":"2024-09-16T14:41:50.953390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4559","last_scrub_stamp":"2024-09-16T14:41:50.953352+0000","last_deep_scrub":"24'4559","last_deep_scrub_stamp":"2024-09-16T14:41:50.953352+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.953352+0000","objects_scrubbed":29,"log_size":4559,"log_dups_size":0,"ondisk_log_size":4559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:58:49.077424+0000","scrub_duration":0.36104712700000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113247232,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4552,"num_write_kb":157847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'6448","reported_seq":6483,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:49.471994+0000","last_change":"2024-09-16T14:41:49.472117+0000","last_active":"2024-09-16T14:41:49.471994+0000","last_peered":"2024-09-16T14:41:49.471994+0000","last_clean":"2024-09-16T14:41:49.471994+0000","last_became_active":"2024-09-16T14:37:23.873310+0000","last_became_peered":"2024-09-16T14:37:23.873310+0000","last_unstale":"2024-09-16T14:41:49.471994+0000","last_undegraded":"2024-09-16T14:41:49.471994+0000","last_fullsized":"2024-09-16T14:41:49.471994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6448","last_scrub_stamp":"2024-09-16T14:41:49.471972+0000","last_deep_scrub":"24'6448","last_deep_scrub_stamp":"2024-09-16T14:41:49.471972+0000","last_clean_scrub_stamp":"2024-09-16T14:41:49.471972+0000","objects_scrubbed":35,"log_size":6448,"log_dups_size":0,"ondisk_log_size":6448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:07:24.023723+0000","scrub_duration":0.462550293,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145360720,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":6379,"num_write_kb":204642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'6483","reported_seq":6512,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:41.941935+0000","last_change":"2024-09-16T14:41:41.942098+0000","last_active":"2024-09-16T14:41:41.941935+0000","last_peered":"2024-09-16T14:41:41.941935+0000","last_clean":"2024-09-16T14:41:41.941935+0000","last_became_active":"2024-09-16T14:37:24.066152+0000","last_became_peered":"2024-09-16T14:37:24.066152+0000","last_unstale":"2024-09-16T14:41:41.941935+0000","last_undegraded":"2024-09-16T14:41:41.941935+0000","last_fullsized":"2024-09-16T14:41:41.941935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6483","last_scrub_stamp":"2024-09-16T14:41:41.941891+0000","last_deep_scrub":"24'6483","last_deep_scrub_stamp":"2024-09-16T14:41:41.941891+0000","last_clean_scrub_stamp":"2024-09-16T14:41:41.941891+0000","objects_scrubbed":32,"log_size":6483,"log_dups_size":0,"ondisk_log_size":6483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:51:22.646685+0000","scrub_duration":0.40636304499999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6431,"num_write_kb":206020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"24'4127","reported_seq":4155,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:48.320582+0000","last_change":"2024-09-16T14:41:48.320582+0000","last_active":"2024-09-16T14:41:48.320582+0000","last_peered":"2024-09-16T14:41:48.320582+0000","last_clean":"2024-09-16T14:41:48.320582+0000","last_became_active":"2024-09-16T14:37:23.873770+0000","last_became_peered":"2024-09-16T14:37:23.873770+0000","last_unstale":"2024-09-16T14:41:48.320582+0000","last_undegraded":"2024-09-16T14:41:48.320582+0000","last_fullsized":"2024-09-16T14:41:48.320582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4127","last_scrub_stamp":"2024-09-16T14:41:48.320455+0000","last_deep_scrub":"24'4127","last_deep_scrub_stamp":"2024-09-16T14:41:48.320455+0000","last_clean_scrub_stamp":"2024-09-16T14:41:48.320455+0000","objects_scrubbed":29,"log_size":4127,"log_dups_size":0,"ondisk_log_size":4127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:18:50.588145+0000","scrub_duration":0.32698546099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4049,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"24'6144","reported_seq":6177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.099031+0000","last_change":"2024-09-16T14:41:50.099031+0000","last_active":"2024-09-16T14:41:50.099031+0000","last_peered":"2024-09-16T14:41:50.099031+0000","last_clean":"2024-09-16T14:41:50.099031+0000","last_became_active":"2024-09-16T14:37:23.872035+0000","last_became_peered":"2024-09-16T14:37:23.872035+0000","last_unstale":"2024-09-16T14:41:50.099031+0000","last_undegraded":"2024-09-16T14:41:50.099031+0000","last_fullsized":"2024-09-16T14:41:50.099031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6144","last_scrub_stamp":"2024-09-16T14:41:50.098873+0000","last_deep_scrub":"24'6144","last_deep_scrub_stamp":"2024-09-16T14:41:50.098873+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.098873+0000","objects_scrubbed":25,"log_size":6144,"log_dups_size":0,"ondisk_log_size":6144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:40:57.369476+0000","scrub_duration":0.35252025300000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97783808,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6122,"num_write_kb":160588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'5263","reported_seq":5597,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:49.113595+0000","last_change":"2024-09-16T14:41:49.113595+0000","last_active":"2024-09-16T14:41:49.113595+0000","last_peered":"2024-09-16T14:41:49.113595+0000","last_clean":"2024-09-16T14:41:49.113595+0000","last_became_active":"2024-09-16T14:37:23.867197+0000","last_became_peered":"2024-09-16T14:37:23.867197+0000","last_unstale":"2024-09-16T14:41:49.113595+0000","last_undegraded":"2024-09-16T14:41:49.113595+0000","last_fullsized":"2024-09-16T14:41:49.113595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5263","last_scrub_stamp":"2024-09-16T14:41:49.113464+0000","last_deep_scrub":"24'5263","last_deep_scrub_stamp":"2024-09-16T14:41:49.113464+0000","last_clean_scrub_stamp":"2024-09-16T14:41:49.113464+0000","objects_scrubbed":27,"log_size":5263,"log_dups_size":0,"ondisk_log_size":5263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:01:54.308281+0000","scrub_duration":0.34071211000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":1023,"num_read_kb":980,"num_write":5443,"num_write_kb":163369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"24'4401","reported_seq":4532,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.709510+0000","last_change":"2024-09-16T14:41:44.709614+0000","last_active":"2024-09-16T14:41:44.709510+0000","last_peered":"2024-09-16T14:41:44.709510+0000","last_clean":"2024-09-16T14:41:44.709510+0000","last_became_active":"2024-09-16T14:37:23.866604+0000","last_became_peered":"2024-09-16T14:37:23.866604+0000","last_unstale":"2024-09-16T14:41:44.709510+0000","last_undegraded":"2024-09-16T14:41:44.709510+0000","last_fullsized":"2024-09-16T14:41:44.709510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4401","last_scrub_stamp":"2024-09-16T14:41:44.709488+0000","last_deep_scrub":"24'4401","last_deep_scrub_stamp":"2024-09-16T14:41:44.709488+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.709488+0000","objects_scrubbed":27,"log_size":4401,"log_dups_size":0,"ondisk_log_size":4401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:18:39.167197+0000","scrub_duration":0.34308872699999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109183504,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":4368,"num_write_kb":166111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"24'6948","reported_seq":6981,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.878746+0000","last_change":"2024-09-16T14:41:44.878746+0000","last_active":"2024-09-16T14:41:44.878746+0000","last_peered":"2024-09-16T14:41:44.878746+0000","last_clean":"2024-09-16T14:41:44.878746+0000","last_became_active":"2024-09-16T14:37:23.871022+0000","last_became_peered":"2024-09-16T14:37:23.871022+0000","last_unstale":"2024-09-16T14:41:44.878746+0000","last_undegraded":"2024-09-16T14:41:44.878746+0000","last_fullsized":"2024-09-16T14:41:44.878746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6948","last_scrub_stamp":"2024-09-16T14:41:44.878619+0000","last_deep_scrub":"24'6948","last_deep_scrub_stamp":"2024-09-16T14:41:44.878619+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.878619+0000","objects_scrubbed":28,"log_size":6948,"log_dups_size":0,"ondisk_log_size":6948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:16:44.621249+0000","scrub_duration":0.420769014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111198208,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":6926,"num_write_kb":195181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'5468","reported_seq":5499,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.144882+0000","last_change":"2024-09-16T14:41:50.144882+0000","last_active":"2024-09-16T14:41:50.144882+0000","last_peered":"2024-09-16T14:41:50.144882+0000","last_clean":"2024-09-16T14:41:50.144882+0000","last_became_active":"2024-09-16T14:37:23.866386+0000","last_became_peered":"2024-09-16T14:37:23.866386+0000","last_unstale":"2024-09-16T14:41:50.144882+0000","last_undegraded":"2024-09-16T14:41:50.144882+0000","last_fullsized":"2024-09-16T14:41:50.144882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5468","last_scrub_stamp":"2024-09-16T14:41:50.144654+0000","last_deep_scrub":"24'5468","last_deep_scrub_stamp":"2024-09-16T14:41:50.144654+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.144654+0000","objects_scrubbed":23,"log_size":5468,"log_dups_size":0,"ondisk_log_size":5468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:52:49.515938+0000","scrub_duration":0.30645684099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":5404,"num_write_kb":164450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:47.829513+0000","last_change":"2024-09-16T14:41:47.829765+0000","last_active":"2024-09-16T14:41:47.829513+0000","last_peered":"2024-09-16T14:41:47.829513+0000","last_clean":"2024-09-16T14:41:47.829513+0000","last_became_active":"2024-09-16T14:37:16.617019+0000","last_became_peered":"2024-09-16T14:37:16.617019+0000","last_unstale":"2024-09-16T14:41:47.829513+0000","last_undegraded":"2024-09-16T14:41:47.829513+0000","last_fullsized":"2024-09-16T14:41:47.829513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:47.829462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:47.829462+0000","last_clean_scrub_stamp":"2024-09-16T14:41:47.829462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:31:45.981457+0000","scrub_duration":0.003130875,"objects_trimmed":0,"snaptrim_duration":0.0019010450000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'4826","reported_seq":4854,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.501610+0000","last_change":"2024-09-16T14:41:43.501610+0000","last_active":"2024-09-16T14:41:43.501610+0000","last_peered":"2024-09-16T14:41:43.501610+0000","last_clean":"2024-09-16T14:41:43.501610+0000","last_became_active":"2024-09-16T14:37:23.874796+0000","last_became_peered":"2024-09-16T14:37:23.874796+0000","last_unstale":"2024-09-16T14:41:43.501610+0000","last_undegraded":"2024-09-16T14:41:43.501610+0000","last_fullsized":"2024-09-16T14:41:43.501610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4826","last_scrub_stamp":"2024-09-16T14:41:43.501402+0000","last_deep_scrub":"24'4826","last_deep_scrub_stamp":"2024-09-16T14:41:43.501402+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.501402+0000","objects_scrubbed":25,"log_size":4826,"log_dups_size":0,"ondisk_log_size":4826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:58:53.034305+0000","scrub_duration":0.34031714699999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4775,"num_write_kb":162435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.192066+0000","last_change":"2024-09-16T14:41:42.192238+0000","last_active":"2024-09-16T14:41:42.192066+0000","last_peered":"2024-09-16T14:41:42.192066+0000","last_clean":"2024-09-16T14:41:42.192066+0000","last_became_active":"2024-09-16T14:37:16.615736+0000","last_became_peered":"2024-09-16T14:37:16.615736+0000","last_unstale":"2024-09-16T14:41:42.192066+0000","last_undegraded":"2024-09-16T14:41:42.192066+0000","last_fullsized":"2024-09-16T14:41:42.192066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:42.192014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:42.192014+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.192014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:34:51.135209+0000","scrub_duration":0.0035016019999999999,"objects_trimmed":0,"snaptrim_duration":0.00076103300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'3481","reported_seq":3507,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:55.229093+0000","last_change":"2024-09-16T14:41:55.229326+0000","last_active":"2024-09-16T14:41:55.229093+0000","last_peered":"2024-09-16T14:41:55.229093+0000","last_clean":"2024-09-16T14:41:55.229093+0000","last_became_active":"2024-09-16T14:37:23.874901+0000","last_became_peered":"2024-09-16T14:37:23.874901+0000","last_unstale":"2024-09-16T14:41:55.229093+0000","last_undegraded":"2024-09-16T14:41:55.229093+0000","last_fullsized":"2024-09-16T14:41:55.229093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3481","last_scrub_stamp":"2024-09-16T14:41:55.229054+0000","last_deep_scrub":"24'3481","last_deep_scrub_stamp":"2024-09-16T14:41:55.229054+0000","last_clean_scrub_stamp":"2024-09-16T14:41:55.229054+0000","objects_scrubbed":21,"log_size":3481,"log_dups_size":0,"ondisk_log_size":3481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:26:34.106140+0000","scrub_duration":0.27552478000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3408,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:48.856966+0000","last_change":"2024-09-16T14:41:48.857179+0000","last_active":"2024-09-16T14:41:48.856966+0000","last_peered":"2024-09-16T14:41:48.856966+0000","last_clean":"2024-09-16T14:41:48.856966+0000","last_became_active":"2024-09-16T14:37:16.294677+0000","last_became_peered":"2024-09-16T14:37:16.294677+0000","last_unstale":"2024-09-16T14:41:48.856966+0000","last_undegraded":"2024-09-16T14:41:48.856966+0000","last_fullsized":"2024-09-16T14:41:48.856966+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:48.856912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:48.856912+0000","last_clean_scrub_stamp":"2024-09-16T14:41:48.856912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:47:13.782381+0000","scrub_duration":0.0028805469999999998,"objects_trimmed":0,"snaptrim_duration":0.0016061129999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"24'5629","reported_seq":5674,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:45.947063+0000","last_change":"2024-09-16T14:41:45.947221+0000","last_active":"2024-09-16T14:41:45.947063+0000","last_peered":"2024-09-16T14:41:45.947063+0000","last_clean":"2024-09-16T14:41:45.947063+0000","last_became_active":"2024-09-16T14:37:23.871068+0000","last_became_peered":"2024-09-16T14:37:23.871068+0000","last_unstale":"2024-09-16T14:41:45.947063+0000","last_undegraded":"2024-09-16T14:41:45.947063+0000","last_fullsized":"2024-09-16T14:41:45.947063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5629","last_scrub_stamp":"2024-09-16T14:41:45.947038+0000","last_deep_scrub":"24'5629","last_deep_scrub_stamp":"2024-09-16T14:41:45.947038+0000","last_clean_scrub_stamp":"2024-09-16T14:41:45.947038+0000","objects_scrubbed":33,"log_size":5629,"log_dups_size":0,"ondisk_log_size":5629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:47:40.147412+0000","scrub_duration":0.44985055000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":5614,"num_write_kb":199780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.805782+0000","last_change":"2024-09-16T14:41:42.805989+0000","last_active":"2024-09-16T14:41:42.805782+0000","last_peered":"2024-09-16T14:41:42.805782+0000","last_clean":"2024-09-16T14:41:42.805782+0000","last_became_active":"2024-09-16T14:37:16.288049+0000","last_became_peered":"2024-09-16T14:37:16.288049+0000","last_unstale":"2024-09-16T14:41:42.805782+0000","last_undegraded":"2024-09-16T14:41:42.805782+0000","last_fullsized":"2024-09-16T14:41:42.805782+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:42.805733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:42.805733+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.805733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T17:07:54.426696+0000","scrub_duration":0.0031812950000000002,"objects_trimmed":0,"snaptrim_duration":0.00058787900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'4178","reported_seq":4215,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.679697+0000","last_change":"2024-09-16T14:41:43.679830+0000","last_active":"2024-09-16T14:41:43.679697+0000","last_peered":"2024-09-16T14:41:43.679697+0000","last_clean":"2024-09-16T14:41:43.679697+0000","last_became_active":"2024-09-16T14:37:23.871465+0000","last_became_peered":"2024-09-16T14:37:23.871465+0000","last_unstale":"2024-09-16T14:41:43.679697+0000","last_undegraded":"2024-09-16T14:41:43.679697+0000","last_fullsized":"2024-09-16T14:41:43.679697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4178","last_scrub_stamp":"2024-09-16T14:41:43.679662+0000","last_deep_scrub":"24'4178","last_deep_scrub_stamp":"2024-09-16T14:41:43.679662+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.679662+0000","objects_scrubbed":25,"log_size":4178,"log_dups_size":0,"ondisk_log_size":4178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:58:00.527289+0000","scrub_duration":0.35579638800000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":4172,"num_write_kb":171144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"24'3360","reported_seq":3411,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:40.799630+0000","last_change":"2024-09-16T14:41:40.799773+0000","last_active":"2024-09-16T14:41:40.799630+0000","last_peered":"2024-09-16T14:41:40.799630+0000","last_clean":"2024-09-16T14:41:40.799630+0000","last_became_active":"2024-09-16T14:37:23.872385+0000","last_became_peered":"2024-09-16T14:37:23.872385+0000","last_unstale":"2024-09-16T14:41:40.799630+0000","last_undegraded":"2024-09-16T14:41:40.799630+0000","last_fullsized":"2024-09-16T14:41:40.799630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3360","last_scrub_stamp":"2024-09-16T14:41:40.799591+0000","last_deep_scrub":"24'3360","last_deep_scrub_stamp":"2024-09-16T14:41:40.799591+0000","last_clean_scrub_stamp":"2024-09-16T14:41:40.799591+0000","objects_scrubbed":26,"log_size":3360,"log_dups_size":0,"ondisk_log_size":3360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T15:48:46.893929+0000","scrub_duration":0.280599771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96731664,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":85,"num_read_kb":129,"num_write":3384,"num_write_kb":160971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"24'3","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:45.772699+0000","last_change":"2024-09-16T14:41:45.772852+0000","last_active":"2024-09-16T14:41:45.772699+0000","last_peered":"2024-09-16T14:41:45.772699+0000","last_clean":"2024-09-16T14:41:45.772699+0000","last_became_active":"2024-09-16T14:37:16.294284+0000","last_became_peered":"2024-09-16T14:37:16.294284+0000","last_unstale":"2024-09-16T14:41:45.772699+0000","last_undegraded":"2024-09-16T14:41:45.772699+0000","last_fullsized":"2024-09-16T14:41:45.772699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-09-16T14:41:45.772623+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-09-16T14:41:45.772623+0000","last_clean_scrub_stamp":"2024-09-16T14:41:45.772623+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T18:37:20.156958+0000","scrub_duration":0.0055674219999999998,"objects_trimmed":0,"snaptrim_duration":0.001611763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"24'3362","reported_seq":3396,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:02.033330+0000","last_change":"2024-09-16T14:42:02.033464+0000","last_active":"2024-09-16T14:42:02.033330+0000","last_peered":"2024-09-16T14:42:02.033330+0000","last_clean":"2024-09-16T14:42:02.033330+0000","last_became_active":"2024-09-16T14:37:23.874911+0000","last_became_peered":"2024-09-16T14:37:23.874911+0000","last_unstale":"2024-09-16T14:42:02.033330+0000","last_undegraded":"2024-09-16T14:42:02.033330+0000","last_fullsized":"2024-09-16T14:42:02.033330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3362","last_scrub_stamp":"2024-09-16T14:42:02.033306+0000","last_deep_scrub":"24'3362","last_deep_scrub_stamp":"2024-09-16T14:42:02.033306+0000","last_clean_scrub_stamp":"2024-09-16T14:42:02.033306+0000","objects_scrubbed":22,"log_size":3362,"log_dups_size":0,"ondisk_log_size":3362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:47:45.357450+0000","scrub_duration":0.275489225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3305,"num_write_kb":152579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.138499+0000","last_change":"2024-09-16T14:41:44.138694+0000","last_active":"2024-09-16T14:41:44.138499+0000","last_peered":"2024-09-16T14:41:44.138499+0000","last_clean":"2024-09-16T14:41:44.138499+0000","last_became_active":"2024-09-16T14:37:16.297106+0000","last_became_peered":"2024-09-16T14:37:16.297106+0000","last_unstale":"2024-09-16T14:41:44.138499+0000","last_undegraded":"2024-09-16T14:41:44.138499+0000","last_fullsized":"2024-09-16T14:41:44.138499+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:44.138452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:44.138452+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.138452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:13:46.396042+0000","scrub_duration":0.002382173,"objects_trimmed":0,"snaptrim_duration":0.00093370300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'4105","reported_seq":4133,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.826521+0000","last_change":"2024-09-16T14:41:43.826668+0000","last_active":"2024-09-16T14:41:43.826521+0000","last_peered":"2024-09-16T14:41:43.826521+0000","last_clean":"2024-09-16T14:41:43.826521+0000","last_became_active":"2024-09-16T14:37:23.875930+0000","last_became_peered":"2024-09-16T14:37:23.875930+0000","last_unstale":"2024-09-16T14:41:43.826521+0000","last_undegraded":"2024-09-16T14:41:43.826521+0000","last_fullsized":"2024-09-16T14:41:43.826521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4105","last_scrub_stamp":"2024-09-16T14:41:43.826496+0000","last_deep_scrub":"24'4105","last_deep_scrub_stamp":"2024-09-16T14:41:43.826496+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.826496+0000","objects_scrubbed":25,"log_size":4105,"log_dups_size":0,"ondisk_log_size":4105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:20:19.169844+0000","scrub_duration":0.33176346099999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4051,"num_write_kb":169350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.781917+0000","last_change":"2024-09-16T14:41:44.782050+0000","last_active":"2024-09-16T14:41:44.781917+0000","last_peered":"2024-09-16T14:41:44.781917+0000","last_clean":"2024-09-16T14:41:44.781917+0000","last_became_active":"2024-09-16T14:37:16.296293+0000","last_became_peered":"2024-09-16T14:37:16.296293+0000","last_unstale":"2024-09-16T14:41:44.781917+0000","last_undegraded":"2024-09-16T14:41:44.781917+0000","last_fullsized":"2024-09-16T14:41:44.781917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T14:41:44.781876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T14:41:44.781876+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.781876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:51:01.410455+0000","scrub_duration":0.003466397,"objects_trimmed":0,"snaptrim_duration":0.00076237699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'4630","reported_seq":4660,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.393244+0000","last_change":"2024-09-16T14:41:44.393425+0000","last_active":"2024-09-16T14:41:44.393244+0000","last_peered":"2024-09-16T14:41:44.393244+0000","last_clean":"2024-09-16T14:41:44.393244+0000","last_became_active":"2024-09-16T14:37:23.873060+0000","last_became_peered":"2024-09-16T14:37:23.873060+0000","last_unstale":"2024-09-16T14:41:44.393244+0000","last_undegraded":"2024-09-16T14:41:44.393244+0000","last_fullsized":"2024-09-16T14:41:44.393244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4630","last_scrub_stamp":"2024-09-16T14:41:44.393205+0000","last_deep_scrub":"24'4630","last_deep_scrub_stamp":"2024-09-16T14:41:44.393205+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.393205+0000","objects_scrubbed":24,"log_size":4630,"log_dups_size":0,"ondisk_log_size":4630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:48:05.437769+0000","scrub_duration":0.277857513,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96536232,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":12,"num_read_kb":135,"num_write":4615,"num_write_kb":187961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"24'2","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:46.800960+0000","last_change":"2024-09-16T14:41:46.801158+0000","last_active":"2024-09-16T14:41:46.800960+0000","last_peered":"2024-09-16T14:41:46.800960+0000","last_clean":"2024-09-16T14:41:46.800960+0000","last_became_active":"2024-09-16T14:37:16.781637+0000","last_became_peered":"2024-09-16T14:37:16.781637+0000","last_unstale":"2024-09-16T14:41:46.800960+0000","last_undegraded":"2024-09-16T14:41:46.800960+0000","last_fullsized":"2024-09-16T14:41:46.800960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-09-16T14:41:46.800904+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-09-16T14:41:46.800904+0000","last_clean_scrub_stamp":"2024-09-16T14:41:46.800904+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:55.829798+0000","scrub_duration":0.0057763729999999996,"objects_trimmed":0,"snaptrim_duration":0.0019145500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":184,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:40.578465+0000","last_change":"2024-09-16T14:41:40.578601+0000","last_active":"2024-09-16T14:41:40.578465+0000","last_peered":"2024-09-16T14:41:40.578465+0000","last_clean":"2024-09-16T14:41:40.578465+0000","last_became_active":"2024-09-16T14:37:15.103063+0000","last_became_peered":"2024-09-16T14:37:15.103063+0000","last_unstale":"2024-09-16T14:41:40.578465+0000","last_undegraded":"2024-09-16T14:41:40.578465+0000","last_fullsized":"2024-09-16T14:41:40.578465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-09-16T14:41:40.578430+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-09-16T14:41:40.578430+0000","last_clean_scrub_stamp":"2024-09-16T14:41:40.578430+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:54:15.136171+0000","scrub_duration":0.0091132959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'3728","reported_seq":3760,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.275480+0000","last_change":"2024-09-16T14:41:50.275624+0000","last_active":"2024-09-16T14:41:50.275480+0000","last_peered":"2024-09-16T14:41:50.275480+0000","last_clean":"2024-09-16T14:41:50.275480+0000","last_became_active":"2024-09-16T14:37:23.874809+0000","last_became_peered":"2024-09-16T14:37:23.874809+0000","last_unstale":"2024-09-16T14:41:50.275480+0000","last_undegraded":"2024-09-16T14:41:50.275480+0000","last_fullsized":"2024-09-16T14:41:50.275480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3728","last_scrub_stamp":"2024-09-16T14:41:50.275454+0000","last_deep_scrub":"24'3728","last_deep_scrub_stamp":"2024-09-16T14:41:50.275454+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.275454+0000","objects_scrubbed":24,"log_size":3728,"log_dups_size":0,"ondisk_log_size":3728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:44:35.091956+0000","scrub_duration":0.27504435500000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88155160,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":3655,"num_write_kb":140764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"24'8805","reported_seq":8956,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:57.304875+0000","last_change":"2024-09-16T14:41:57.304998+0000","last_active":"2024-09-16T14:41:57.304875+0000","last_peered":"2024-09-16T14:41:57.304875+0000","last_clean":"2024-09-16T14:41:57.304875+0000","last_became_active":"2024-09-16T14:37:23.870990+0000","last_became_peered":"2024-09-16T14:37:23.870990+0000","last_unstale":"2024-09-16T14:41:57.304875+0000","last_undegraded":"2024-09-16T14:41:57.304875+0000","last_fullsized":"2024-09-16T14:41:57.304875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'8805","last_scrub_stamp":"2024-09-16T14:41:57.304852+0000","last_deep_scrub":"24'8805","last_deep_scrub_stamp":"2024-09-16T14:41:57.304852+0000","last_clean_scrub_stamp":"2024-09-16T14:41:57.304852+0000","objects_scrubbed":35,"log_size":8805,"log_dups_size":0,"ondisk_log_size":8805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:32:57.646860+0000","scrub_duration":0.41306886999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":416,"num_read_kb":374,"num_write":6755,"num_write_kb":203154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"24'4618","reported_seq":4646,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:05.290922+0000","last_change":"2024-09-16T14:42:05.291087+0000","last_active":"2024-09-16T14:42:05.290922+0000","last_peered":"2024-09-16T14:42:05.290922+0000","last_clean":"2024-09-16T14:42:05.290922+0000","last_became_active":"2024-09-16T14:37:23.864034+0000","last_became_peered":"2024-09-16T14:37:23.864034+0000","last_unstale":"2024-09-16T14:42:05.290922+0000","last_undegraded":"2024-09-16T14:42:05.290922+0000","last_fullsized":"2024-09-16T14:42:05.290922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4618","last_scrub_stamp":"2024-09-16T14:42:05.290887+0000","last_deep_scrub":"24'4618","last_deep_scrub_stamp":"2024-09-16T14:42:05.290887+0000","last_clean_scrub_stamp":"2024-09-16T14:42:05.290887+0000","objects_scrubbed":34,"log_size":4618,"log_dups_size":0,"ondisk_log_size":4618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T22:11:16.890237+0000","scrub_duration":0.43678970700000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4557,"num_write_kb":210052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"24'3949","reported_seq":3977,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:46.440421+0000","last_change":"2024-09-16T14:41:46.440421+0000","last_active":"2024-09-16T14:41:46.440421+0000","last_peered":"2024-09-16T14:41:46.440421+0000","last_clean":"2024-09-16T14:41:46.440421+0000","last_became_active":"2024-09-16T14:37:23.874573+0000","last_became_peered":"2024-09-16T14:37:23.874573+0000","last_unstale":"2024-09-16T14:41:46.440421+0000","last_undegraded":"2024-09-16T14:41:46.440421+0000","last_fullsized":"2024-09-16T14:41:46.440421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3949","last_scrub_stamp":"2024-09-16T14:41:46.440233+0000","last_deep_scrub":"24'3949","last_deep_scrub_stamp":"2024-09-16T14:41:46.440233+0000","last_clean_scrub_stamp":"2024-09-16T14:41:46.440233+0000","objects_scrubbed":25,"log_size":3949,"log_dups_size":0,"ondisk_log_size":3949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T21:05:54.948239+0000","scrub_duration":0.31215353400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3921,"num_write_kb":193410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"24'2831","reported_seq":2857,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:50.563732+0000","last_change":"2024-09-16T14:41:50.563732+0000","last_active":"2024-09-16T14:41:50.563732+0000","last_peered":"2024-09-16T14:41:50.563732+0000","last_clean":"2024-09-16T14:41:50.563732+0000","last_became_active":"2024-09-16T14:37:23.874099+0000","last_became_peered":"2024-09-16T14:37:23.874099+0000","last_unstale":"2024-09-16T14:41:50.563732+0000","last_undegraded":"2024-09-16T14:41:50.563732+0000","last_fullsized":"2024-09-16T14:41:50.563732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2831","last_scrub_stamp":"2024-09-16T14:41:50.563592+0000","last_deep_scrub":"24'2831","last_deep_scrub_stamp":"2024-09-16T14:41:50.563592+0000","last_clean_scrub_stamp":"2024-09-16T14:41:50.563592+0000","objects_scrubbed":19,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:09:38.275643+0000","scrub_duration":0.19784163799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78251856,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2763,"num_write_kb":122330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"24'4001","reported_seq":4040,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:51.316025+0000","last_change":"2024-09-16T14:41:51.316025+0000","last_active":"2024-09-16T14:41:51.316025+0000","last_peered":"2024-09-16T14:41:51.316025+0000","last_clean":"2024-09-16T14:41:51.316025+0000","last_became_active":"2024-09-16T14:37:23.865656+0000","last_became_peered":"2024-09-16T14:37:23.865656+0000","last_unstale":"2024-09-16T14:41:51.316025+0000","last_undegraded":"2024-09-16T14:41:51.316025+0000","last_fullsized":"2024-09-16T14:41:51.316025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4001","last_scrub_stamp":"2024-09-16T14:41:51.315879+0000","last_deep_scrub":"24'4001","last_deep_scrub_stamp":"2024-09-16T14:41:51.315879+0000","last_clean_scrub_stamp":"2024-09-16T14:41:51.315879+0000","objects_scrubbed":33,"log_size":4001,"log_dups_size":0,"ondisk_log_size":4001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T23:11:20.795566+0000","scrub_duration":0.43038587299999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":44,"num_read_kb":36,"num_write":3967,"num_write_kb":169347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'4582","reported_seq":4720,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:42.624914+0000","last_change":"2024-09-16T14:41:42.624914+0000","last_active":"2024-09-16T14:41:42.624914+0000","last_peered":"2024-09-16T14:41:42.624914+0000","last_clean":"2024-09-16T14:41:42.624914+0000","last_became_active":"2024-09-16T14:37:23.868935+0000","last_became_peered":"2024-09-16T14:37:23.868935+0000","last_unstale":"2024-09-16T14:41:42.624914+0000","last_undegraded":"2024-09-16T14:41:42.624914+0000","last_fullsized":"2024-09-16T14:41:42.624914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4582","last_scrub_stamp":"2024-09-16T14:41:42.624775+0000","last_deep_scrub":"24'4582","last_deep_scrub_stamp":"2024-09-16T14:41:42.624775+0000","last_clean_scrub_stamp":"2024-09-16T14:41:42.624775+0000","objects_scrubbed":25,"log_size":4582,"log_dups_size":0,"ondisk_log_size":4582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:18:41.793270+0000","scrub_duration":0.28491039899999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100073992,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":376,"num_read_kb":299,"num_write":4840,"num_write_kb":173375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'2718","reported_seq":2746,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:43.737897+0000","last_change":"2024-09-16T14:41:43.737897+0000","last_active":"2024-09-16T14:41:43.737897+0000","last_peered":"2024-09-16T14:41:43.737897+0000","last_clean":"2024-09-16T14:41:43.737897+0000","last_became_active":"2024-09-16T14:37:23.868262+0000","last_became_peered":"2024-09-16T14:37:23.868262+0000","last_unstale":"2024-09-16T14:41:43.737897+0000","last_undegraded":"2024-09-16T14:41:43.737897+0000","last_fullsized":"2024-09-16T14:41:43.737897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2718","last_scrub_stamp":"2024-09-16T14:41:43.737651+0000","last_deep_scrub":"24'2718","last_deep_scrub_stamp":"2024-09-16T14:41:43.737651+0000","last_clean_scrub_stamp":"2024-09-16T14:41:43.737651+0000","objects_scrubbed":20,"log_size":2718,"log_dups_size":0,"ondisk_log_size":2718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T19:03:57.840849+0000","scrub_duration":0.23583225399999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79823376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":2657,"num_write_kb":119691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"24'3820","reported_seq":3854,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:46.042236+0000","last_change":"2024-09-16T14:41:46.042236+0000","last_active":"2024-09-16T14:41:46.042236+0000","last_peered":"2024-09-16T14:41:46.042236+0000","last_clean":"2024-09-16T14:41:46.042236+0000","last_became_active":"2024-09-16T14:37:24.065966+0000","last_became_peered":"2024-09-16T14:37:24.065966+0000","last_unstale":"2024-09-16T14:41:46.042236+0000","last_undegraded":"2024-09-16T14:41:46.042236+0000","last_fullsized":"2024-09-16T14:41:46.042236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3820","last_scrub_stamp":"2024-09-16T14:41:46.042104+0000","last_deep_scrub":"24'3820","last_deep_scrub_stamp":"2024-09-16T14:41:46.042104+0000","last_clean_scrub_stamp":"2024-09-16T14:41:46.042104+0000","objects_scrubbed":31,"log_size":3820,"log_dups_size":0,"ondisk_log_size":3820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T20:51:10.389787+0000","scrub_duration":0.378229027,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":3750,"num_write_kb":213570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"24'2660","reported_seq":2686,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:08.185307+0000","last_change":"2024-09-16T14:42:08.185428+0000","last_active":"2024-09-16T14:42:08.185307+0000","last_peered":"2024-09-16T14:42:08.185307+0000","last_clean":"2024-09-16T14:42:08.185307+0000","last_became_active":"2024-09-16T14:37:23.866545+0000","last_became_peered":"2024-09-16T14:37:23.866545+0000","last_unstale":"2024-09-16T14:42:08.185307+0000","last_undegraded":"2024-09-16T14:42:08.185307+0000","last_fullsized":"2024-09-16T14:42:08.185307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2660","last_scrub_stamp":"2024-09-16T14:42:08.185283+0000","last_deep_scrub":"24'2660","last_deep_scrub_stamp":"2024-09-16T14:42:08.185283+0000","last_clean_scrub_stamp":"2024-09-16T14:42:08.185283+0000","objects_scrubbed":20,"log_size":2660,"log_dups_size":0,"ondisk_log_size":2660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T00:50:14.843278+0000","scrub_duration":0.25300161500000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2634,"num_write_kb":119555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"24'2427","reported_seq":2453,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:41:44.784952+0000","last_change":"2024-09-16T14:41:44.784952+0000","last_active":"2024-09-16T14:41:44.784952+0000","last_peered":"2024-09-16T14:41:44.784952+0000","last_clean":"2024-09-16T14:41:44.784952+0000","last_became_active":"2024-09-16T14:37:23.873069+0000","last_became_peered":"2024-09-16T14:37:23.873069+0000","last_unstale":"2024-09-16T14:41:44.784952+0000","last_undegraded":"2024-09-16T14:41:44.784952+0000","last_fullsized":"2024-09-16T14:41:44.784952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2427","last_scrub_stamp":"2024-09-16T14:41:44.784733+0000","last_deep_scrub":"24'2427","last_deep_scrub_stamp":"2024-09-16T14:41:44.784733+0000","last_clean_scrub_stamp":"2024-09-16T14:41:44.784733+0000","objects_scrubbed":22,"log_size":2427,"log_dups_size":0,"ondisk_log_size":2427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T02:16:05.474373+0000","scrub_duration":0.26607209100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88145920,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2351,"num_write_kb":101825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"24'7789","reported_seq":7819,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T14:42:02.344745+0000","last_change":"2024-09-16T14:42:02.344745+0000","last_active":"2024-09-16T14:42:02.344745+0000","last_peered":"2024-09-16T14:42:02.344745+0000","last_clean":"2024-09-16T14:42:02.344745+0000","last_became_active":"2024-09-16T14:37:23.868469+0000","last_became_peered":"2024-09-16T14:37:23.868469+0000","last_unstale":"2024-09-16T14:42:02.344745+0000","last_undegraded":"2024-09-16T14:42:02.344745+0000","last_fullsized":"2024-09-16T14:42:02.344745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7789","last_scrub_stamp":"2024-09-16T14:42:02.344571+0000","last_deep_scrub":"24'7789","last_deep_scrub_stamp":"2024-09-16T14:42:02.344571+0000","last_clean_scrub_stamp":"2024-09-16T14:42:02.344571+0000","objects_scrubbed":31,"log_size":7789,"log_dups_size":0,"ondisk_log_size":7789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T01:23:31.932621+0000","scrub_duration":0.47415724799999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":7743,"num_write_kb":271203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3548455160,"num_objects":873,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":873,"num_whiteouts":0,"num_read":2563,"num_read_kb":2579,"num_write":150750,"num_write_kb":5600677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6780297216,"data_stored":6795560056,"data_compressed":70367536,"data_compressed_allocated":73326592,"data_compressed_original":92856320,"omap_allocated":0,"internal_metadata":0},"log_size":153437,"ondisk_log_size":153437,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1057856,"data_compressed":60036,"data_compressed_allocated":81920,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542208,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1043960,"kb_used_data":778288,"kb_used_omap":1,"kb_used_meta":265662,"kb_avail":93327880,"statfs":{"total":96636764160,"available":95567749120,"internally_reserved":0,"allocated":796966912,"data_stored":799458522,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":1593,"internal_metadata":272038343},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.68100000000000005},"min":{"1min":0.40200000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.3660000000000001,"5min":3.6789999999999998,"15min":3.6789999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.80200000000000005,"15min":0.71399999999999997},"min":{"1min":0.48399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.214,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":0.90500000000000003}]},{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.94899999999999995,"15min":1.0940000000000001},"min":{"1min":0.503,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.1519999999999999,"5min":10.654999999999999,"15min":10.654999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70799999999999996,"15min":0.65300000000000002},"min":{"1min":0.371,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.522,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.97299999999999998}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.745,"15min":0.65900000000000003},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.079,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.86899999999999999,"15min":0.82399999999999995},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0960000000000001,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":0.82399999999999995}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":1.365,"15min":1.3280000000000001},"min":{"1min":0.45400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.571,"5min":28.141999999999999,"15min":28.141999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.0800000000000001,"15min":0.81799999999999995},"min":{"1min":0.42199999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.069,"5min":28.109999999999999,"15min":28.109999999999999},"last":1.1160000000000001}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90000000000000002,"15min":0.91800000000000004},"min":{"1min":0.41599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.208,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.91900000000000004,"15min":0.876},"min":{"1min":0.434,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.256,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.87}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.202,"15min":1.46},"min":{"1min":0.66700000000000004,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.1719999999999999,"5min":14.289,"15min":14.289},"last":1.157},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.97099999999999997,"15min":0.92100000000000004},"min":{"1min":0.67800000000000005,"5min":0.31,"15min":0.31},"max":{"1min":1.4710000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0169999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":0.96799999999999997,"15min":0.91300000000000003},"min":{"1min":0.57299999999999995,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6279999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.95199999999999996,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2949999999999999,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.196}]}]},{"osd":2,"up_from":14,"seq":60129542209,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1148008,"kb_used_data":850336,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93223832,"statfs":{"total":96636764160,"available":95461203968,"internally_reserved":0,"allocated":870744064,"data_stored":872705543,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.57199999999999995,"15min":0.50600000000000001},"min":{"1min":0.41299999999999998,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":1.048,"5min":1.857,"15min":1.857},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.60099999999999998,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63}]},{"osd":1,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":1.0249999999999999},"min":{"1min":0.46600000000000003,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.2170000000000001,"5min":12.141,"15min":12.141},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.61799999999999999},"min":{"1min":0.48099999999999998,"5min":0.224,"15min":0.224},"max":{"1min":1.1990000000000001,"5min":1.657,"15min":1.657},"last":0.86499999999999999}]},{"osd":3,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.65200000000000002,"15min":0.62},"min":{"1min":0.39900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.97499999999999998,"5min":1.077,"15min":1.077},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.60799999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.81299999999999994}]},{"osd":4,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96399999999999997,"15min":0.86599999999999999},"min":{"1min":0.623,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.508,"5min":6.5549999999999997,"15min":6.5549999999999997},"last":1.224},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0669999999999999,"15min":0.999},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.633,"5min":9.1690000000000005,"15min":9.1690000000000005},"last":1.3200000000000001}]},{"osd":5,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.94899999999999995,"15min":0.93500000000000005},"min":{"1min":0.71599999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5589999999999999,"5min":1.786,"15min":1.786},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.97899999999999998,"15min":0.871},"min":{"1min":0.67700000000000005,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2649999999999999,"5min":5.7869999999999999,"15min":5.7869999999999999},"last":1.1559999999999999}]},{"osd":6,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.94899999999999995,"15min":0.90400000000000003},"min":{"1min":0.86199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.462,"5min":1.968,"15min":1.968},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.0149999999999999,"15min":0.95899999999999996},"min":{"1min":0.86599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.516,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0980000000000001}]},{"osd":7,"last update":"Mon Sep 16 14:42:19 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.03,"15min":0.96099999999999997},"min":{"1min":0.86499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.4810000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.27},{"interface":"front","average":{"1min":1.022,"5min":0.97799999999999998,"15min":0.90700000000000003},"min":{"1min":0.73199999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3200000000000001,"5min":1.7,"15min":1.7},"last":1.002}]}]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1191468,"kb_used_data":935652,"kb_used_omap":1,"kb_used_meta":255806,"kb_avail":93180372,"statfs":{"total":96636764160,"available":95416700928,"internally_reserved":0,"allocated":958107648,"data_stored":959426311,"data_compressed":13128965,"data_compressed_allocated":13701120,"data_compressed_original":15773696,"omap_allocated":1594,"internal_metadata":261945798},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.70299999999999996,"15min":0.79800000000000004},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":1.181,"5min":3.02,"15min":3.02},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71799999999999997,"15min":0.80200000000000005},"min":{"1min":0.26400000000000001,"5min":0.184,"15min":0.184},"max":{"1min":1.0920000000000001,"5min":3.141,"15min":3.141},"last":0.86499999999999999}]},{"osd":2,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.82199999999999995,"15min":1.0369999999999999},"min":{"1min":0.217,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.96899999999999997,"5min":8.5220000000000002,"15min":8.5220000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.873,"15min":1.0580000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.202,"5min":8.4800000000000004,"15min":8.4800000000000004},"last":0.755}]},{"osd":3,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":1.427,"15min":1.383},"min":{"1min":0.32400000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.82299999999999995,"5min":48.195,"15min":48.195},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.748,"5min":1.4379999999999999,"15min":2.069},"min":{"1min":0.31,"5min":0.246,"15min":0.246},"max":{"1min":1.2609999999999999,"5min":25.248000000000001,"15min":25.248000000000001},"last":0.94699999999999995}]},{"osd":4,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79600000000000004,"15min":0.76300000000000001},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3759999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.165},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91400000000000003,"15min":0.88600000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.544,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.85099999999999998}]},{"osd":5,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.024,"15min":1.1120000000000001},"min":{"1min":0.54900000000000004,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.206,"5min":5.819,"15min":5.819},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88,"15min":0.83199999999999996},"min":{"1min":0.59499999999999997,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.371,"5min":1.611,"15min":1.611},"last":1.095}]},{"osd":6,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.98099999999999998,"15min":0.94699999999999995},"min":{"1min":0.439,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6479999999999999,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.0369999999999999,"15min":1.0589999999999999},"min":{"1min":0.59399999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.3620000000000001,"5min":4.7960000000000003,"15min":4.7960000000000003},"last":1.0189999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1,"15min":0.91200000000000003},"min":{"1min":0.62,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.466,"5min":5.0439999999999996,"15min":5.0439999999999996},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.92200000000000004,"15min":0.875},"min":{"1min":0.51300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3240000000000001,"5min":1.544,"15min":1.544},"last":0.99199999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1259380,"kb_used_data":921516,"kb_used_omap":1,"kb_used_meta":337854,"kb_avail":93112460,"statfs":{"total":96636764160,"available":95347159040,"internally_reserved":0,"allocated":943632384,"data_stored":944635399,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":1594,"internal_metadata":345962950},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.49299999999999999,"15min":0.42299999999999999},"min":{"1min":0.316,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.73299999999999998},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.88700000000000001,"5min":4.9779999999999998,"15min":4.9779999999999998},"last":0.76800000000000002}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.747,"15min":0.79700000000000004},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91300000000000003,"5min":5.0839999999999996,"15min":5.0839999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.96699999999999997,"15min":1.149},"min":{"1min":0.307,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0449999999999999,"5min":7.6040000000000001,"15min":7.6040000000000001},"last":0.90900000000000003}]},{"osd":3,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.262,"15min":1.8340000000000001},"min":{"1min":0.28100000000000003,"5min":0.248,"15min":0.248},"max":{"1min":1.2050000000000001,"5min":17.472000000000001,"15min":17.472000000000001},"last":0.75},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73399999999999999,"15min":0.78200000000000003},"min":{"1min":0.30199999999999999,"5min":0.254,"15min":0.254},"max":{"1min":1.073,"5min":3.9649999999999999,"15min":3.9649999999999999},"last":0.81200000000000006}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.82799999999999996,"15min":0.77300000000000002},"min":{"1min":0.42399999999999999,"5min":0.307,"15min":0.307},"max":{"1min":1.224,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.054},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.3,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.1739999999999999,"15min":1.423},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.4239999999999999,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.998},{"interface":"front","average":{"1min":1.02,"5min":0.998,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.343,"5min":5.9429999999999996,"15min":5.9429999999999996},"last":0.85799999999999998}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.95199999999999996,"15min":0.92000000000000004},"min":{"1min":0.433,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3300000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.173,"15min":1.363},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":1.4970000000000001,"5min":7.5570000000000004,"15min":7.5570000000000004},"last":1.1799999999999999}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0880000000000001,"15min":1.1759999999999999},"min":{"1min":0.48799999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.528,"5min":7.5819999999999999,"15min":7.5819999999999999},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.081,"5min":1.0589999999999999,"15min":1.079},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4870000000000001,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":1.1279999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":531228,"kb_used_data":432020,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93840612,"statfs":{"total":96636764160,"available":96092786688,"internally_reserved":0,"allocated":442388480,"data_stored":444222051,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":1589,"internal_metadata":101579211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.245,"15min":0.245},"max":{"1min":1.1639999999999999,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.753},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.85399999999999998,"15min":0.71199999999999997},"min":{"1min":0.499,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1180000000000001,"5min":8.6959999999999997,"15min":8.6959999999999997},"last":0.93700000000000006}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76000000000000001,"15min":0.67700000000000005},"min":{"1min":0.33400000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.085,"5min":1.907,"15min":1.907},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78600000000000003,"15min":0.69799999999999995},"min":{"1min":0.49099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.999,"5min":5.798,"15min":5.798},"last":0.96199999999999997}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.84199999999999997,"15min":0.78600000000000003},"min":{"1min":0.56200000000000006,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.169,"5min":4.109,"15min":4.109},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.91400000000000003,"15min":0.82699999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.327,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":0.875}]},{"osd":3,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.498,"15min":1.98},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":24.472000000000001,"15min":24.472000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":1.0740000000000001,"15min":1.258},"min":{"1min":0.55300000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.1240000000000001,"5min":6.6139999999999999,"15min":6.6139999999999999},"last":0.89200000000000002}]},{"osd":4,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82699999999999996,"15min":0.76800000000000002},"min":{"1min":0.42699999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.29,"5min":1.377,"15min":1.377},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.77000000000000002},"min":{"1min":0.41199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":1.413,"5min":1.581,"15min":1.581},"last":0.78400000000000003}]},{"osd":5,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.83399999999999996},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.339,"5min":1.712,"15min":1.712},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.93000000000000005,"15min":0.86299999999999999},"min":{"1min":0.59199999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2010000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.008,"15min":0.93999999999999995},"min":{"1min":0.51800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3069999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.012},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.248,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.0329999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1226124,"kb_used_data":880068,"kb_used_omap":1,"kb_used_meta":346046,"kb_avail":93145716,"statfs":{"total":96636764160,"available":95381213184,"internally_reserved":0,"allocated":901189632,"data_stored":902465855,"data_compressed":6836315,"data_compressed_allocated":7131136,"data_compressed_original":9027584,"omap_allocated":1594,"internal_metadata":354351558},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.76500000000000001,"15min":0.69499999999999995},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.161,"5min":6.4800000000000004,"15min":6.4800000000000004},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.82299999999999995},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3620000000000001,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":0.92200000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.96399999999999997,"15min":1.034},"min":{"1min":0.45300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.046,"5min":4.3029999999999999,"15min":4.3029999999999999},"last":1.153},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.91400000000000003,"15min":1.0329999999999999},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":5.9539999999999997,"15min":5.9539999999999997},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.82899999999999996,"15min":0.78100000000000003},"min":{"1min":0.44600000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1910000000000001,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.075},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.88,"15min":0.84599999999999997},"min":{"1min":0.49399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.21,"5min":4.3300000000000001,"15min":4.3300000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89000000000000001,"15min":0.84599999999999997},"min":{"1min":0.35299999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.244,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.0489999999999999,"15min":1.0369999999999999},"min":{"1min":0.49299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.2250000000000001,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.01}]},{"osd":4,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82299999999999995,"15min":0.81699999999999995},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.145,"5min":1.319,"15min":1.319},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93700000000000006,"5min":4.2720000000000002,"15min":7.6070000000000002},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.399,"5min":91.039000000000001,"15min":91.039000000000001},"last":1.113}]},{"osd":6,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.873,"15min":0.85099999999999998},"min":{"1min":0.47999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.2789999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.99199999999999999,"15min":0.94899999999999995},"min":{"1min":0.45900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2789999999999999,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.234}]},{"osd":7,"last update":"Mon Sep 16 14:41:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.006,"15min":0.94299999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.337,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.175},{"interface":"front","average":{"1min":1.133,"5min":1.1000000000000001,"15min":1.024},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.593,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":1.212}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":989688,"kb_used_data":729776,"kb_used_omap":1,"kb_used_meta":259902,"kb_avail":93382152,"statfs":{"total":96636764160,"available":95623323648,"internally_reserved":0,"allocated":747290624,"data_stored":750299371,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":1594,"internal_metadata":266140102},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.82599999999999996,"15min":0.93799999999999994},"min":{"1min":0.38600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.097,"5min":4.617,"15min":4.617},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.66900000000000004,"15min":0.623},"min":{"1min":0.32800000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79100000000000004}]},{"osd":1,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83999999999999997,"15min":0.94499999999999995},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.3520000000000001,"5min":4.7370000000000001,"15min":4.7370000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.95099999999999996,"15min":1.117},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.212,"5min":4.6580000000000004,"15min":4.6580000000000004},"last":0.83099999999999996}]},{"osd":2,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.40899999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0840000000000001,"5min":2.528,"15min":2.528},"last":1.206},{"interface":"front","average":{"1min":0.872,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.36099999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.4530000000000001,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.93899999999999995}]},{"osd":3,"last update":"Mon Sep 16 14:42:17 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.90200000000000002,"15min":0.879},"min":{"1min":0.77300000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.196,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.90300000000000002,"15min":0.88500000000000001},"min":{"1min":0.77300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1950000000000001,"5min":1.7709999999999999,"15min":1.7709999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Mon Sep 16 14:42:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.84399999999999997,"15min":0.76200000000000001},"min":{"1min":0.70999999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2589999999999999,"5min":2.726,"15min":2.726},"last":0.751},{"interface":"front","average":{"1min":1.111,"5min":0.97999999999999998,"15min":0.84899999999999998},"min":{"1min":0.72599999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.427,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.254}]},{"osd":6,"last update":"Mon Sep 16 14:41:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0640000000000001},"min":{"1min":0.40000000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.633,"5min":6.9320000000000004,"15min":6.9320000000000004},"last":1.153},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.42699999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4330000000000001,"5min":1.782,"15min":1.782},"last":1.018}]},{"osd":7,"last update":"Mon Sep 16 14:42:17 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.024,"15min":1.125},"min":{"1min":0.85299999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.367,"5min":4.556,"15min":4.556},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.081,"15min":0.95699999999999996},"min":{"1min":0.98099999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5489999999999999,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.2949999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1483556,"kb_used_data":1095644,"kb_used_omap":1,"kb_used_meta":387902,"kb_avail":92888284,"statfs":{"total":96636764160,"available":95117602816,"internally_reserved":0,"allocated":1121939456,"data_stored":1124037310,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":1592,"internal_metadata":397212104},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.58199999999999996,"15min":0.621},"min":{"1min":0.27900000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.84099999999999997,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":1.0269999999999999},"min":{"1min":0.34499999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.004,"5min":12.147,"15min":12.147},"last":0.61099999999999999}]},{"osd":1,"last update":"Mon Sep 16 14:41:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.309,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.28,"5min":1.718,"15min":1.718},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.71099999999999997,"15min":0.63400000000000001},"min":{"1min":0.23599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.77900000000000003,"5min":8.3919999999999995,"15min":8.3919999999999995},"last":0.52900000000000003}]},{"osd":2,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.85299999999999998},"min":{"1min":0.39300000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.95299999999999996,"5min":7.0519999999999996,"15min":7.0519999999999996},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.89900000000000002,"15min":0.88600000000000001},"min":{"1min":0.36299999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.0920000000000001,"5min":8.4410000000000007,"15min":8.4410000000000007},"last":0.66300000000000003}]},{"osd":4,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":1.5389999999999999,"15min":2.1070000000000002},"min":{"1min":0.433,"5min":0.309,"15min":0.309},"max":{"1min":1.482,"5min":29.449000000000002,"15min":29.449000000000002},"last":1.042},{"interface":"front","average":{"1min":0.85599999999999998,"5min":1.1140000000000001,"15min":1.1279999999999999},"min":{"1min":0.47499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.161,"5min":8.4499999999999993,"15min":8.4499999999999993},"last":0.83399999999999996}]},{"osd":5,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.1479999999999999,"15min":1.042},"min":{"1min":0.432,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":11.983000000000001,"5min":11.983000000000001,"15min":11.983000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.242,"15min":1.5740000000000001},"min":{"1min":0.5,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.22,"5min":13.377000000000001,"15min":13.377000000000001},"last":0.94699999999999995}]},{"osd":6,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.161,"15min":1.337},"min":{"1min":0.58599999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.2549999999999999,"5min":13.334,"15min":13.334},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0129999999999999,"15min":1.0449999999999999},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.569,"5min":4.3940000000000001,"15min":4.3940000000000001},"last":0.80600000000000005}]},{"osd":7,"last update":"Mon Sep 16 14:41:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.1499999999999999,"15min":1.0609999999999999},"min":{"1min":0.52500000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.7050000000000001,"5min":8.6829999999999998,"15min":8.6829999999999998},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.2010000000000001,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.0070000000000001,"5min":8.7050000000000001,"15min":8.7050000000000001},"last":1.0900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":528928,"data_compressed":30018,"data_compressed_allocated":40960,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":943403008,"data_stored":944556228,"data_compressed":10135419,"data_compressed_allocated":10563584,"data_compressed_original":12353536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":957816832,"data_stored":958818212,"data_compressed":13098947,"data_compressed_allocated":13660160,"data_compressed_original":15261696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":870514688,"data_stored":872626372,"data_compressed":8477711,"data_compressed_allocated":8818688,"data_compressed_original":11485184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1121705984,"data_stored":1123958120,"data_compressed":7258419,"data_compressed_allocated":7544832,"data_compressed_original":10440704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":747061248,"data_stored":750220200,"data_compressed":9653556,"data_compressed_allocated":10092544,"data_compressed_original":13778944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":900898816,"data_stored":901857756,"data_compressed":6806297,"data_compressed_allocated":7090176,"data_compressed_original":8515584,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":796737536,"data_stored":799380288,"data_compressed":9139000,"data_compressed_allocated":9510912,"data_compressed_original":12636160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":442159104,"data_stored":444142880,"data_compressed":5798187,"data_compressed_allocated":6045696,"data_compressed_original":8384512,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T14:42:24.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T14:42:24.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.271+0000 7f8c2bfff700 1 Processor -- start 2024-09-16T14:42:24.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.271+0000 7f8c2bfff700 1 -- start start 2024-09-16T14:42:24.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c134d70 con 0x7f8c2c0afb90 2024-09-16T14:42:24.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c141910 con 0x7f8c2c1413f0 2024-09-16T14:42:24.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c06f0b0 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2affd700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8c2c06ecd0 0x7f8c2c141da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41484/0 (socket says 172.21.15.73:41484) 2024-09-16T14:42:24.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2affd700 1 -- 172.21.15.73:0/3266818850 learned_addr learned my addr 172.21.15.73:0/3266818850 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513857709 0 0) 0x7f8c2c06f0b0 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c140035d0 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724637924 0 0) 0x7f8c2c134d70 con 0x7f8c2c0afb90 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c06f0b0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39105964 0 0) 0x7f8c2c141910 con 0x7f8c2c1413f0 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c134d70 con 0x7f8c2c1413f0 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2895479212 0 0) 0x7f8c140035d0 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 >> v1:172.21.15.177:6789/0 conn(0x7f8c2c1413f0 legacy=0x7f8c2c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 >> v1:172.21.15.73:6789/0 conn(0x7f8c2c0afb90 legacy=0x7f8c2c13de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c13e580 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8c1c001590 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.2 v1:172.21.15.73:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8c1c0017b0 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c29ffb700 1 -- 172.21.15.73:0/3266818850 <== mon.2 v1:172.21.15.73:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8c1c001ac0 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- 172.21.15.73:0/3266818850 >> v1:172.21.15.73:6790/0 conn(0x7f8c2c06ecd0 legacy=0x7f8c2c141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- 172.21.15.73:0/3266818850 shutdown_connections 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- 172.21.15.73:0/3266818850 >> 172.21.15.73:0/3266818850 conn(0x7f8c2c0b3e50 msgr2=0x7f8c2c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- 172.21.15.73:0/3266818850 shutdown_connections 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.275+0000 7f8c2bfff700 1 -- 172.21.15.73:0/3266818850 wait complete. 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 Processor -- start 2024-09-16T14:42:24.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 -- start start 2024-09-16T14:42:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c1d6f50 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c13bd20 con 0x7f8c2c0adf70 2024-09-16T14:42:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 -- --> v1:172.21.15.73:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c1d6b90 con 0x7f8c2c0afb90 2024-09-16T14:42:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2a7fc700 1 --1- >> v1:172.21.15.73:6790/0 conn(0x7f8c2c0afb90 0x7f8c2c13af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6790/0 says I am v1:172.21.15.73:41500/0 (socket says 172.21.15.73:41500) 2024-09-16T14:42:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2a7fc700 1 -- 172.21.15.73:0/897263064 learned_addr learned my addr 172.21.15.73:0/897263064 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-09-16T14:42:24.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2affd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8c2c06ecd0 0x7f8c2c1d6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48182/0 (socket says 172.21.15.73:48182) 2024-09-16T14:42:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183370800 0 0) 0x7f8c2c1d6b90 con 0x7f8c2c0afb90 2024-09-16T14:42:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c180035d0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86248281 0 0) 0x7f8c2c1d6f50 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c1d6b90 con 0x7f8c2c06ecd0 2024-09-16T14:42:24.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689624905 0 0) 0x7f8c2c13bd20 con 0x7f8c2c0adf70 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c1d6f50 con 0x7f8c2c0adf70 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4200676440 0 0) 0x7f8c180035d0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c2c13bd20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8c20001940 con 0x7f8c2c0afb90 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3226210383 0 0) 0x7f8c2c1d6f50 con 0x7f8c2c0adf70 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.177:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8c180035d0 con 0x7f8c2c0adf70 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8c24001c30 con 0x7f8c2c0adf70 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2578397569 0 0) 0x7f8c2c13bd20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 >> v1:172.21.15.177:6789/0 conn(0x7f8c2c0adf70 legacy=0x7f8c2c13b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 >> v1:172.21.15.73:6789/0 conn(0x7f8c2c06ecd0 legacy=0x7f8c2c1d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c1d3d20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c06a360 con 0x7f8c2c0afb90 2024-09-16T14:42:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8c200036c0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c06a7f0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.279+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2937490984 0 0) 0x7f8c200039d0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.283+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c1d6d20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.283+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 7 ==== mgrmap(e 5) v1 ==== 86057+0+0 (unknown 3701619642 0 0) 0x7f8c20003bb0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.283+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 8 ==== osd_map(24..24 src has 1..24) v4 ==== 4525+0+0 (unknown 2948403436 0 0) 0x7f8c2007f6c0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.291+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (unknown 1092875540 0 3652978863) 0x7f8c2c1d6d20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.459+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 --> v1:172.21.15.73:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f8c2c1d6d20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 10 ==== config(1 keys) v1 ==== 35+0+0 (unknown 2555425225 0 0) 0x7f8c2007f8f0 con 0x7f8c2c0afb90 2024-09-16T14:42:24.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c137fe700 1 -- 172.21.15.73:0/897263064 <== mon.2 v1:172.21.15.73:6790/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (unknown 1453024670 0 0) 0x7f8c2c1d6d20 con 0x7f8c2c0afb90 2024-09-16T14:42:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 >> v1:172.21.15.177:6816/2823028339 conn(0x7f8c18069420 legacy=0x7f8c1806b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 >> v1:172.21.15.73:6790/0 conn(0x7f8c2c0afb90 legacy=0x7f8c2c13af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T14:42:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 shutdown_connections 2024-09-16T14:42:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 >> 172.21.15.73:0/897263064 conn(0x7f8c2c0b3e50 msgr2=0x7f8c2c140aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T14:42:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 shutdown_connections 2024-09-16T14:42:24.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-16T14:42:24.475+0000 7f8c2bfff700 1 -- 172.21.15.73:0/897263064 wait complete. 2024-09-16T14:42:24.493 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T14:42:24.493 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T14:42:24.494 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T14:42:24.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:28.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-16T14:42:30.595 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T14:42:30.596 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T14:42:30.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:30.690 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T14:42:30.690 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T14:42:30.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:30.779 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T14:42:30.779 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T14:42:30.780 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:34.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-16T14:42:34.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-16T14:42:36.882 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T14:42:36.882 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T14:42:36.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:36.974 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T14:42:36.974 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T14:42:36.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:40.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-16T14:42:40.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-16T14:42:43.076 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T14:42:43.077 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-16T14:42:43.077 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:43.163 INFO:tasks.ceph.osd.6:Stopped 2024-09-16T14:42:43.163 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-16T14:42:43.163 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:45.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-16T14:42:45.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-16T14:42:49.265 INFO:tasks.ceph.osd.7:Stopped 2024-09-16T14:42:49.265 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T14:42:49.266 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T14:42:49.266 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:49.299 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T14:42:49.299 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T14:42:49.300 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:49.335 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T14:42:49.335 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T14:42:49.335 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T14:42:49.335 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:49.380 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T14:42:49.381 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T14:42:49.381 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:49.424 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T14:42:49.424 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T14:42:49.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T14:42:49.480 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T14:42:49.480 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T14:42:49.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-09-16T14:42:49.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:42:49.501 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T14:42:49.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:42:49.836 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T14:42:50.039 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:42:50.039 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T14:42:50.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:42:50.227 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T14:42:50.447 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:42:50.448 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T14:42:50.711 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:42:50.711 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T14:42:50.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-16T14:42:50.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:42:50.925 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T14:42:51.092 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:42:51.092 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T14:42:51.261 INFO:tasks.ceph:Archiving mon data... 2024-09-16T14:42:51.262 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/data/mon.a.tgz 2024-09-16T14:42:51.262 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-16T14:42:51.269 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.c9NVapvOnz 2024-09-16T14:42:51.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.c9NVapvOnz 2024-09-16T14:42:51.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.c9NVapvOnz 2024-09-16T14:42:51.467 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.c9NVapvOnz is 307KB 2024-09-16T14:42:51.530 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.c9NVapvOnz 2024-09-16T14:42:51.536 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/data/mon.c.tgz 2024-09-16T14:42:51.537 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-16T14:42:51.543 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.sQxxowwe7w 2024-09-16T14:42:51.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sQxxowwe7w 2024-09-16T14:42:51.618 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.sQxxowwe7w 2024-09-16T14:42:51.642 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.sQxxowwe7w is 308KB 2024-09-16T14:42:51.706 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.sQxxowwe7w 2024-09-16T14:42:51.713 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/data/mon.b.tgz 2024-09-16T14:42:51.713 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-09-16T14:42:51.720 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.OsEagotpD3 2024-09-16T14:42:51.720 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OsEagotpD3 2024-09-16T14:42:51.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.OsEagotpD3 2024-09-16T14:42:51.867 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.OsEagotpD3 is 308KB 2024-09-16T14:42:51.926 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.OsEagotpD3 2024-09-16T14:42:51.933 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T14:42:51.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T14:42:51.936 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T14:42:51.951 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-16T14:42:51.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T14:42:51.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-16T14:42:51.976 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T14:42:51.982 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-16T14:42:51.988 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T14:42:51.990 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/remote/smithi073/crash 2024-09-16T14:42:51.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T14:42:52.048 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/remote/smithi177/crash 2024-09-16T14:42:52.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T14:42:52.065 INFO:tasks.ceph:Compressing logs... 2024-09-16T14:42:52.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T14:42:52.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T14:43:55.406 INFO:tasks.ceph:Archiving logs... 2024-09-16T14:43:55.407 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/remote/smithi073/log 2024-09-16T14:43:55.408 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T14:44:03.995 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/remote/smithi177/log 2024-09-16T14:44:03.996 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T14:44:10.051 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T14:44:10.064 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T14:44:10.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T14:44:10.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T14:44:10.143 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T14:44:10.151 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T14:44:10.151 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:44:10.154 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T14:44:10.175 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:44:10.175 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2024-09-16T14:44:10.175 INFO:teuthology.orchestra.run.smithi177.stdout:*hv01.front.sepi 67.205.162.81 3 u 51 64 377 0.067 -0.491 0.370 2024-09-16T14:44:10.175 INFO:teuthology.orchestra.run.smithi177.stdout:+hv02.front.sepi 63.231.80.2 3 u 51 64 377 0.107 -0.058 0.339 2024-09-16T14:44:10.175 INFO:teuthology.orchestra.run.smithi177.stdout:+hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.074 -0.928 0.366 2024-09-16T14:44:10.175 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:44:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-09-16T14:44:10.177 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-09-16T14:44:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi 67.205.162.81 3 u 52 64 377 0.063 -0.081 0.070 2024-09-16T14:44:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.087 0.390 0.059 2024-09-16T14:44:10.177 INFO:teuthology.orchestra.run.smithi073.stdout:*hv03.front.sepi 74.6.168.72 3 u 57 64 377 0.081 -0.073 0.132 2024-09-16T14:44:10.177 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-16T14:44:10.177 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T14:44:10.186 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T14:44:10.187 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T14:44:10.195 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T14:44:10.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T14:44:10.256 INFO:teuthology.task.internal:Duration was 927.116885 seconds 2024-09-16T14:44:10.256 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T14:44:10.265 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T14:44:10.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T14:44:10.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T14:44:10.320 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T14:44:10.320 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-16T14:44:10.321 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T14:44:10.332 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-09-16T14:44:10.332 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T14:44:10.346 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T14:44:10.347 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T14:44:10.349 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T14:44:10.385 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T14:44:10.385 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T14:44:10.425 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T14:44:10.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T14:44:10.503 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T14:44:10.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T14:44:10.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T14:44:10.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T14:44:10.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T14:44:10.545 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T14:44:10.557 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-16T14:44:10.559 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-09-16T14:44:10.584 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T14:44:10.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:44:10.621 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T14:44:10.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T14:44:10.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T14:44:10.637 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T14:44:10.638 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/remote/smithi073 2024-09-16T14:44:10.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T14:44:10.665 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_22:00:02-rados-reef-distro-default-smithi/7906742/remote/smithi177 2024-09-16T14:44:10.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T14:44:10.693 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T14:44:10.693 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T14:44:10.695 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T14:44:10.701 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T14:44:10.713 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T14:44:10.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T14:44:10.736 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T14:44:10.736 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T14:44:10.745 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T14:44:10.751 INFO:teuthology.orchestra.run.smithi073.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 14:44 /home/ubuntu/cephtest 2024-09-16T14:44:10.753 INFO:teuthology.orchestra.run.smithi177.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 14:44 /home/ubuntu/cephtest 2024-09-16T14:44:10.755 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T14:44:10.765 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T14:44:10.787 INFO:teuthology.run:Summary data: description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_20.04} tasks/libcephsqlite} duration: 927.1168851852417 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T14:44:10.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T14:44:10.869 INFO:teuthology.run:pass